You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-02-17 - 17:50
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack0slot2.osadl.org (updated Mon Feb 17, 2025 12:43:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
10862002630,0sleep40-21swapper/415:52:254
105472425342,8sleep40-21swapper/415:38:404
105493324232,7sleep50-21swapper/515:41:385
105472624030,7sleep60-21swapper/615:38:426
10455102393,31sleep70-21swapper/715:37:147
1055262993129,2cyclictest1235030-21kworker/u16:0+events_unbound17:27:236
1055262993129,2cyclictest1055860-21kworker/u16:2+events_unbound15:42:356
1055262993028,2cyclictest1476749-21kworker/u16:3+flush-8:019:27:206
1055262993028,2cyclictest1434086-21kworker/u16:2+events_unbound19:25:046
1055262993028,2cyclictest1370088-21kworker/u16:3+events_unbound18:32:346
1055262993028,2cyclictest1358029-21kworker/u16:1+events_unbound18:11:046
1055262993027,2cyclictest1508515-21kworker/u16:0+events_unbound20:07:216
1055262992927,2cyclictest1443783-21kworker/u16:1+events_unbound20:50:236
1055262992927,2cyclictest1235030-21kworker/u16:0+events_unbound17:21:046
1055262992927,2cyclictest1197663-21kworker/u16:3+events_unbound17:00:046
1055262992927,2cyclictest1031118-21kworker/u16:4+events_unbound16:07:046
1055262992926,2cyclictest1625283-21kworker/u16:0+events_unbound20:57:236
1055262992826,2cyclictest317586-21kworker/u16:3+flush-8:016:12:256
1055262992826,2cyclictest1562349-21kworker/u16:0+events_unbound20:42:306
1055262992826,2cyclictest1338121-21kworker/u16:4+events_unbound18:05:166
105526399270,25cyclictest1529621-21latency_hist19:57:047
1055262992725,2cyclictest1508515-21kworker/u16:0+events_unbound19:43:236
1055262992725,2cyclictest1443783-21kworker/u16:1+events_unbound19:52:266
1055262992725,2cyclictest1412431-21kworker/u16:4+flush-8:018:47:146
1055262992725,2cyclictest1235030-21kworker/u16:0+flush-8:017:32:336
1055262992725,2cyclictest1172217-21kworker/u16:2+events_unbound16:43:066
105526399260,24cyclictest643-21systemd-journal21:11:587
1055262992624,2cyclictest1551356-21kworker/u16:3+events_unbound20:15:146
1055262992624,2cyclictest1518943-21kworker/u16:5+flush-8:020:21:386
1055262992624,2cyclictest1444821-21kworker/u16:5+events_unbound19:18:046
1055262992624,2cyclictest1443783-21kworker/u16:1+events_unbound20:36:036
1055262992623,2cyclictest1370088-21kworker/u16:3+events_unbound18:20:156
105526399250,23cyclictest1615314-21latency_hist20:52:047
1055262992523,2cyclictest1646296-21kworker/u16:3+events_unbound21:07:326
1055262992523,2cyclictest1443783-21kworker/u16:1+events_unbound19:12:226
1055262992523,2cyclictest1235030-21kworker/u16:0+flush-8:017:47:346
1055262992523,2cyclictest1235030-21kworker/u16:0+events_unbound17:07:336
1055262992523,2cyclictest1150988-21kworker/u16:4+events_unbound16:32:056
1055262992522,2cyclictest1518943-21kworker/u16:5+events_unbound20:40:116
1055262992522,2cyclictest1487849-21kworker/u16:4+events_unbound19:39:036
12755982240,0chrt0-21swapper/417:27:044
1055262992422,2cyclictest317586-21kworker/u16:3+events_unbound15:51:076
1055262992422,2cyclictest317586-21kworker/u16:3+events_unbound15:51:076
1055262992422,2cyclictest1626546-21kworker/u16:2+events_unbound21:06:146
1055262992422,2cyclictest1562349-21kworker/u16:0+events_unbound20:31:156
1055262992422,2cyclictest1518943-21kworker/u16:5+events_unbound20:55:396
1055262992422,2cyclictest1518943-21kworker/u16:5+events_unbound20:23:036
1055262992422,2cyclictest1443783-21kworker/u16:1+events_unbound19:33:406
1055262992422,2cyclictest1412431-21kworker/u16:4+events_unbound19:05:046
1055262992422,2cyclictest1370088-21kworker/u16:3+events_unbound19:01:146
1055262992422,2cyclictest1358029-21kworker/u16:1+events_unbound18:16:486
1055262992422,2cyclictest1250154-21kworker/u16:4+events_unbound17:25:036
1055262992422,2cyclictest1172217-21kworker/u16:2+events_unbound17:13:526
1055262992422,2cyclictest1150988-21kworker/u16:4+events_unbound17:03:156
1055262992422,2cyclictest1119892-21kworker/u16:0+events_unbound16:41:046
1055262992422,2cyclictest1119892-21kworker/u16:0+events_unbound16:41:046
14671842230,1chrt1467189-21sed19:22:057
105526399230,21cyclictest1583311-21latency_hist20:32:037
1055262992321,2cyclictest1518943-21kworker/u16:5+events_unbound19:49:556
1055262992321,2cyclictest1518943-21kworker/u16:5+events_unbound19:49:556
1055262992321,2cyclictest1358029-21kworker/u16:1+flush-8:018:42:216
1055262992321,2cyclictest1172217-21kworker/u16:2+events_unbound17:37:336
1055262992320,2cyclictest1031118-21kworker/u16:4+flush-8:015:57:076
105526399222,19cyclictest27944-21gnome-software19:48:317
105526399222,19cyclictest27944-21gnome-software19:48:317
105526399220,21cyclictest643-21systemd-journal18:31:597
1055262992220,2cyclictest1197663-21kworker/u16:3+events_unbound16:53:396
105526399210,20cyclictest1370606-21cut18:22:047
1055262992119,2cyclictest1444821-21kworker/u16:5+flush-8:019:07:246
1055262992119,2cyclictest1443783-21kworker/u16:1+events_unbound20:01:396
1055262992119,2cyclictest1370088-21kworker/u16:3+events_unbound18:23:276
1055262992119,2cyclictest1358029-21kworker/u16:1+flush-8:018:31:246
1055262992119,2cyclictest1326066-21kworker/u16:5+events_unbound17:57:396
1055262992119,2cyclictest1235030-21kworker/u16:0+events_unbound17:43:156
1055262992119,2cyclictest1172217-21kworker/u16:2+events_unbound16:52:036
1055262992119,2cyclictest1089828-21kworker/u16:1+events_unbound16:29:156
1055262992018,2cyclictest1412431-21kworker/u16:4+flush-8:018:52:226
1055262992018,2cyclictest1235030-21kworker/u16:0+events_unbound17:53:276
1055262992018,2cyclictest1031118-21kworker/u16:4+events_unbound15:54:086
105526399190,17cyclictest1317414-21exim417:47:057
1055262991917,2cyclictest1518943-21kworker/u16:5+events_unbound20:03:116
105526399180,16cyclictest1224004-21latency_hist17:02:047
1055262991815,2cyclictest1369572-21kworker/u16:2+events_unbound18:41:266
1055262991715,2cyclictest317586-21kworker/u16:3+events_unbound16:09:276
105526399160,15cyclictest1313-21snmpd16:52:117
105526399160,15cyclictest1313-21snmpd15:44:037
1055262991614,2cyclictest1119892-21kworker/u16:0+events_unbound16:21:206
1055263991512,2cyclictest1348798-21idleruntime-cro18:07:037
1055262991513,2cyclictest1150988-21kworker/u16:4+events_unbound16:25:366
105525399150,1cyclictest0-21swapper/416:34:344
105525399150,13cyclictest0-21swapper/417:35:254
105526399140,13cyclictest1313-21snmpd16:44:357
105526399140,12cyclictest1468046-21cat19:22:157
105526399140,12cyclictest1359780-21/usr/sbin/munin18:12:317
105525899140,1cyclictest0-21swapper/519:02:235
105525899140,1cyclictest0-21swapper/516:23:385
105525399140,14cyclictest0-21swapper/419:02:264
105525399140,12cyclictest0-21swapper/421:05:244
105526399130,2cyclictest1171598-21ntpq16:32:307
105526399130,12cyclictest1500052-21cat19:42:157
105526399130,12cyclictest1402477-21latency_hist18:42:047
105526399130,12cyclictest1313-21snmpd20:33:287
105526399130,12cyclictest1305387-21ntpq17:37:317
105526399130,11cyclictest1313-21snmpd19:07:057
105526399130,11cyclictest1307079-21sendmail17:42:057
1055258991312,1cyclictest0-21swapper/519:34:325
105525899130,1cyclictest0-21swapper/516:19:035
1055253991310,3cyclictest0-21swapper/418:35:484
105525399130,1cyclictest0-21swapper/416:53:384
105525399130,13cyclictest0-21swapper/419:13:384
105526399126,5cyclictest27394-21gmain16:17:227
105526399125,6cyclictest27430-21gmain18:32:307
1055263991210,1cyclictest1561600-21turbostat20:17:047
105526399120,3cyclictest1481860-21kthreadcore19:27:267
105526399120,3cyclictest1202468-21ntpq16:47:327
105526399120,2cyclictest1624640-21ntpq20:52:297
105526399120,2cyclictest1604094-21ntpq20:42:267
105526399120,2cyclictest1541719-21/usr/sbin/munin20:07:327
105526399120,2cyclictest1455853-21/usr/sbin/munin19:12:277
105526399120,2cyclictest1286522-21/usr/sbin/munin17:32:217
105526399120,12cyclictest96-21ksoftirqd/720:02:157
105526399120,11cyclictest1435801-21grep19:02:147
105526399120,11cyclictest1313-21snmpd20:20:587
105526399120,11cyclictest1313-21snmpd18:26:167
105526399120,11cyclictest1313-21snmpd17:28:457
105526399120,11cyclictest1233334-21ntpq17:02:337
105526399120,10cyclictest1414021-21df_inode18:47:197
105526399120,10cyclictest1328564-21cat17:52:207
105526399120,10cyclictest1246498-21irqstats17:12:227
1055258991211,1cyclictest0-21swapper/520:50:125
1055258991211,1cyclictest0-21swapper/520:01:395
1055258991211,1cyclictest0-21swapper/518:30:325
1055258991211,1cyclictest0-21swapper/518:13:405
1055258991211,1cyclictest0-21swapper/517:39:375
1055258991211,1cyclictest0-21swapper/516:55:005
1055258991211,1cyclictest0-21swapper/516:50:265
1055258991211,1cyclictest0-21swapper/516:45:515
105525899120,1cyclictest0-21swapper/517:26:325
105525899120,11cyclictest0-21swapper/519:37:325
105525899120,11cyclictest0-21swapper/518:37:575
105525399128,1cyclictest0-21swapper/419:21:494
105525399125,2cyclictest0-21swapper/415:47:234
105525399125,2cyclictest0-21swapper/415:47:234
1055253991211,1cyclictest0-21swapper/420:38:454
1055253991211,1cyclictest0-21swapper/416:03:594
105525399120,9cyclictest0-21swapper/418:50:294
105525399120,9cyclictest0-21swapper/417:52:074
105525399120,1cyclictest0-21swapper/415:58:374
105525399120,12cyclictest0-21swapper/418:52:494
105525399120,12cyclictest0-21swapper/417:20:074
105525399120,11cyclictest0-21swapper/418:18:084
105526399115,5cyclictest27763-21gvfs-afc-volume20:22:197
105526399114,6cyclictest27763-21gvfs-afc-volume19:32:367
105526399114,6cyclictest27763-21gvfs-afc-volume18:52:067
105526399110,9cyclictest1173273-21/usr/sbin/munin16:37:197
105526399110,9cyclictest1173273-21/usr/sbin/munin16:37:197
105526399110,9cyclictest1101931-21cat16:02:237
105526399110,2cyclictest1403212-21/usr/sbin/munin18:42:127
105526399110,2cyclictest1351508-21tr18:07:237
105526399110,2cyclictest1265922-21/usr/sbin/munin17:22:317
105526399110,2cyclictest1142367-21/usr/sbin/munin16:22:177
105526399110,2cyclictest1112210-21hddtemp_smartct16:07:227
105526399110,2cyclictest1086976-21tr15:52:267
105526399110,10cyclictest1313-21snmpd19:59:247
105526399110,10cyclictest1313-21snmpd19:41:007
105526399110,10cyclictest1313-21snmpd17:19:117
105526399110,10cyclictest1235808-21cat17:07:217
1055258991110,1cyclictest0-21swapper/520:02:265
1055258991110,1cyclictest0-21swapper/519:46:315
1055258991110,1cyclictest0-21swapper/518:21:425
1055258991110,1cyclictest0-21swapper/517:07:565
1055258991110,1cyclictest0-21swapper/516:14:295
105525899110,1cyclictest0-21swapper/516:40:305
105525899110,1cyclictest0-21swapper/516:40:305
105525899110,11cyclictest0-21swapper/520:54:475
105525899110,11cyclictest0-21swapper/520:25:095
105525899110,11cyclictest0-21swapper/519:54:525
105525899110,11cyclictest0-21swapper/519:28:335
105525899110,11cyclictest0-21swapper/517:15:305
105525899110,11cyclictest0-21swapper/516:35:085
105525899110,11cyclictest0-21swapper/516:28:595
105525399119,2cyclictest0-21swapper/416:14:424
105525399118,1cyclictest0-21swapper/417:10:214
1055253991110,1cyclictest0-21swapper/421:00:504
1055253991110,1cyclictest0-21swapper/420:43:204
1055253991110,1cyclictest0-21swapper/420:34:584
1055253991110,1cyclictest0-21swapper/420:22:504
1055253991110,1cyclictest0-21swapper/418:43:124
1055253991110,1cyclictest0-21swapper/418:15:564
1055253991110,1cyclictest0-21swapper/417:49:464
1055253991110,1cyclictest0-21swapper/416:58:134
105525399110,9cyclictest0-21swapper/418:24:534
105525399110,11cyclictest0-21swapper/417:05:014
105525399110,11cyclictest0-21swapper/416:39:554
105525399110,11cyclictest0-21swapper/416:39:554
105525399110,11cyclictest0-21swapper/415:43:104
105526399100,9cyclictest0-21swapper/717:57:137
105526399100,3cyclictest1626566-21sshd-session21:00:237
105526399100,3cyclictest1070235-21sshd-session15:47:137
105526399100,3cyclictest1070235-21sshd-session15:47:137
105526399100,2cyclictest1627429-21/usr/sbin/munin21:02:287
105526399100,2cyclictest1158181-21kthreadcore16:27:257
105526399100,2cyclictest1131-21lldpd18:58:507
105526399100,2cyclictest1121770-21/usr/sbin/munin16:12:337
105526399100,2cyclictest1090864-21/usr/sbin/munin15:57:287
105525899109,1cyclictest0-21swapper/521:10:525
105525899109,1cyclictest0-21swapper/521:05:305
105525899109,1cyclictest0-21swapper/521:00:085
105525899109,1cyclictest0-21swapper/519:47:185
105525899109,1cyclictest0-21swapper/519:47:185
105525899109,1cyclictest0-21swapper/519:25:335
105525899109,1cyclictest0-21swapper/517:59:485
105525899109,1cyclictest0-21swapper/517:19:175
105525899109,1cyclictest0-21swapper/516:59:345
105525899109,1cyclictest0-21swapper/515:59:125
105525899109,1cyclictest0-21swapper/515:53:035
105525899109,1cyclictest0-21swapper/515:51:285
105525899109,1cyclictest0-21swapper/515:51:285
105525899100,10cyclictest0-21swapper/516:04:335
105525399109,1cyclictest0-21swapper/421:10:454
105525399109,1cyclictest0-21swapper/420:56:154
105525399109,1cyclictest0-21swapper/420:50:544
105525399109,1cyclictest0-21swapper/420:18:164
105525399109,1cyclictest0-21swapper/419:53:214
105525399109,1cyclictest0-21swapper/419:10:384
105525399109,1cyclictest0-21swapper/416:29:124
10552639991,7cyclictest1279-21tuned20:37:257
10552589998,1cyclictest0-21swapper/520:38:515
10552589998,1cyclictest0-21swapper/520:17:355
10552589998,1cyclictest0-21swapper/519:17:215
10552589998,1cyclictest0-21swapper/518:52:465
10552589998,1cyclictest0-21swapper/518:26:075
10552589998,1cyclictest0-21swapper/518:07:505
10552539998,1cyclictest0-21swapper/420:27:244
10552539998,1cyclictest0-21swapper/417:28:104
10552539998,1cyclictest0-21swapper/416:45:174
10552539998,1cyclictest0-21swapper/416:23:514
10552539998,1cyclictest0-21swapper/416:19:164
10552539993,5cyclictest27396-21gdbus19:48:324
10552539993,5cyclictest27396-21gdbus19:48:324
10552539990,9cyclictest0-21swapper/418:09:324
10552539990,9cyclictest0-21swapper/416:07:414
10552589987,1cyclictest0-21swapper/519:14:225
10552589987,1cyclictest0-21swapper/519:08:225
10552589986,1cyclictest0-21swapper/515:42:205
10552539987,1cyclictest0-21swapper/419:33:484
10552539987,1cyclictest0-21swapper/419:22:374
10552539980,8cyclictest0-21swapper/420:00:074
10552539980,8cyclictest0-21swapper/416:48:384
10552589976,1cyclictest0-21swapper/520:46:255
10552589976,1cyclictest0-21swapper/520:16:475
10552589976,1cyclictest0-21swapper/518:33:325
10552589976,1cyclictest0-21swapper/518:05:385
10552589976,1cyclictest0-21swapper/517:46:055
10552589976,1cyclictest0-21swapper/517:33:095
10552589976,1cyclictest0-21swapper/517:27:195
10552539976,1cyclictest0-21swapper/419:42:474
10552539976,1cyclictest0-21swapper/419:42:004
10552539976,1cyclictest0-21swapper/418:58:014
10552539976,1cyclictest0-21swapper/417:37:374
10552539970,7cyclictest0-21swapper/417:14:144
10552589965,1cyclictest0-21swapper/520:30:305
10552589965,1cyclictest0-21swapper/518:43:095
10552589965,1cyclictest0-21swapper/517:56:105
10552589965,1cyclictest0-21swapper/517:04:095
10552589965,1cyclictest0-21swapper/516:09:555
10552589963,2cyclictest15503052sleep520:07:315
10552539965,1cyclictest0-21swapper/420:14:294
10552539965,1cyclictest0-21swapper/420:07:424
10552539965,1cyclictest0-21swapper/418:02:514
10552539962,2cyclictest0-21swapper/417:43:494
10552539960,4cyclictest0-21swapper/419:28:134
10552539960,1cyclictest0-21swapper/418:37:284
10552539960,1cyclictest0-21swapper/418:29:274
10552589952,2cyclictest1321516-21taskset17:47:245
10552589951,1cyclictest681rcuog/418:49:175
10552589950,4cyclictest1593381-21chrt20:33:585
10552589950,4cyclictest1434120-21chrt18:57:355
10552539950,4cyclictest1531442-21chrt20:02:084
10552539950,1cyclictest0-21swapper/417:57:204
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional