You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-09 - 05:55
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot2.osadl.org (updated Fri May 09, 2025 00:43:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16440852660,0sleep40-21swapper/407:52:104
110542525646,7sleep50-21swapper/503:33:395
110559625521,30sleep70-21swapper/703:36:067
110550724634,8sleep40-21swapper/403:34:514
1105945993532,2cyclictest1531093-21kworker/u16:1+flush-8:007:31:444
1105950993432,2cyclictest1459720-21kworker/u16:2+flush-8:006:56:446
1105950993431,2cyclictest1531093-21kworker/u16:1+events_unbound07:26:566
1105950993331,2cyclictest829632-21kworker/u16:2+flush-8:004:31:446
1105955993130,0cyclictest0-21swapper/707:18:537
1105955993130,0cyclictest0-21swapper/707:18:537
1105955993130,0cyclictest0-21swapper/706:02:227
1105945993129,2cyclictest1253038-21kworker/u16:4+events_unbound04:54:534
110562223121,7sleep60-21swapper/603:36:296
1105950993028,2cyclictest1308799-21kworker/u16:0+flush-8:005:26:446
1105945993027,2cyclictest1308799-21kworker/u16:0+flush-8:005:16:544
1105955992928,0cyclictest0-21swapper/707:05:537
1105950992927,2cyclictest1654995-21kworker/u16:2+flush-8:008:46:436
1105950992926,2cyclictest1419483-21kworker/u16:2+events_unbound06:11:576
1105950992926,2cyclictest1308799-21kworker/u16:0+events_unbound05:26:466
1105947992926,2cyclictest1268883-21kworker/u16:5+flush-8:005:26:595
1105945992926,2cyclictest1325185-21kworker/u16:1+flush-8:005:52:094
1105955992827,0cyclictest0-21swapper/705:52:547
1105955992827,0cyclictest0-21swapper/703:53:537
1105950992826,2cyclictest1706820-21kworker/u16:0+flush-8:008:26:436
1105950992825,2cyclictest1116294-21kworker/u16:3+events_unbound03:46:546
1105947992826,2cyclictest1157379-21kworker/u16:4+events_unbound04:11:265
1105947992825,2cyclictest1583188-21kworker/u16:5+events_unbound07:45:265
1105947992825,2cyclictest1141350-21kworker/u16:1+events_unbound04:37:225
1105945992825,2cyclictest1737257-21kworker/u16:5+events_unbound08:42:084
1105955992726,0cyclictest0-21swapper/704:15:587
1105955992724,2cyclictest1251-21tuned-ppd07:59:057
110595599270,26cyclictest0-21swapper/703:42:097
1105947992725,2cyclictest829632-21kworker/u16:2+events_unbound04:18:425
1105947992725,2cyclictest1490525-21kworker/u16:0+events_unbound08:09:445
1105947992725,2cyclictest1490525-21kworker/u16:0+events_unbound07:54:255
1105947992725,2cyclictest1116294-21kworker/u16:3+events_unbound03:49:505
1105945992724,2cyclictest1273525-21kworker/u16:6+events_unbound05:07:144
1105945992723,3cyclictest1268883-21kworker/u16:5+events_unbound05:27:044
1105955992625,0cyclictest0-21swapper/708:14:217
1105955992625,0cyclictest0-21swapper/706:27:537
1105955992625,0cyclictest0-21swapper/704:34:537
1105950992623,2cyclictest1268883-21kworker/u16:5+events_unbound04:56:466
1105950992623,2cyclictest1268883-21kworker/u16:5+events_unbound04:56:466
1105950992622,3cyclictest1490525-21kworker/u16:0+flush-8:007:56:586
1105947992624,2cyclictest352228-21kworker/u16:1+events_unbound03:40:225
1105947992624,2cyclictest1500812-21kworker/u16:1+events_unbound06:45:185
1105947992624,2cyclictest1469265-21kworker/u16:5+events_unbound06:53:585
1105947992624,2cyclictest1388110-21kworker/u16:0+events_unbound06:15:105
1105947992624,2cyclictest1388110-21kworker/u16:0+events_unbound06:04:145
1105947992624,2cyclictest1308799-21kworker/u16:0+events_unbound05:37:575
1105947992624,2cyclictest1268883-21kworker/u16:5+events_unbound05:14:145
1105947992624,2cyclictest1253038-21kworker/u16:4+events_unbound04:46:415
1105947992624,2cyclictest1157379-21kworker/u16:4+events_unbound04:34:435
1105947992624,2cyclictest1157379-21kworker/u16:4+events_unbound04:16:155
1105947992624,2cyclictest1141350-21kworker/u16:1+events_unbound04:00:145
1105945992624,2cyclictest1623868-21kworker/u16:4+flush-8:007:47:454
16249202250,1chrt1624677-21latency_hist07:46:447
1105955992524,0cyclictest0-21swapper/706:10:457
1105955992524,0cyclictest0-21swapper/704:23:157
1105955992523,1cyclictest1707140-21awk08:26:437
1105955992523,1cyclictest1116159-21awk03:41:447
110595599250,23cyclictest1645338-21latency_hist07:56:437
1105950992523,2cyclictest1459720-21kworker/u16:2+events_unbound06:27:136
1105950992522,2cyclictest829632-21kworker/u16:2+events_unbound04:02:136
1105950992522,2cyclictest1441590-21kworker/u16:4+events_unbound06:21:456
1105950992522,2cyclictest1325185-21kworker/u16:1+events_unbound05:56:466
1105947992523,2cyclictest1706820-21kworker/u16:0+events_unbound08:54:255
1105947992523,2cyclictest1623868-21kworker/u16:4+events_unbound07:48:575
1105947992523,2cyclictest1595135-21kworker/u16:3+events_unbound07:39:145
1105947992523,2cyclictest1469265-21kworker/u16:5+events_unbound06:58:065
1105947992523,2cyclictest1460118-21kworker/u16:3+events_unbound06:29:055
1105947992523,2cyclictest1459720-21kworker/u16:2+events_unbound06:41:065
1105947992523,2cyclictest1419483-21kworker/u16:2+events_unbound06:11:355
1105947992523,2cyclictest1388110-21kworker/u16:0+events_unbound06:21:185
1105947992523,2cyclictest1253038-21kworker/u16:4+events_unbound05:03:455
1105947992523,2cyclictest1253038-21kworker/u16:4+events_unbound04:50:145
1105947992523,2cyclictest1181966-21kworker/u16:0+flush-8:004:26:145
1105945992523,2cyclictest1490525-21kworker/u16:0+flush-8:007:01:394
1105945992523,2cyclictest1441590-21kworker/u16:4+flush-8:006:26:534
1105945992522,2cyclictest1157379-21kworker/u16:4+flush-8:004:07:054
1105955992423,0cyclictest0-21swapper/707:26:427
1105955992422,1cyclictest1769923-21sendmail08:56:447
1105950992422,2cyclictest1308799-21kworker/u16:0+flush-8:005:41:386
1105950992422,2cyclictest1268883-21kworker/u16:5+flush-8:004:56:436
1105950992422,2cyclictest1181966-21kworker/u16:0+events_unbound04:36:466
1105950992421,2cyclictest1531093-21kworker/u16:1+flush-8:007:12:036
1105947992422,2cyclictest1706820-21kworker/u16:0+flush-8:008:37:455
1105947992422,2cyclictest1706820-21kworker/u16:0+events_unbound09:05:495
1105947992422,2cyclictest1654995-21kworker/u16:2+events_unbound09:00:565
1105947992422,2cyclictest1654995-21kworker/u16:2+events_unbound07:58:575
1105947992422,2cyclictest1636989-21kworker/u16:1+events_unbound08:12:535
1105947992422,2cyclictest1593520-21kworker/u16:2+events_unbound07:30:015
1105947992422,2cyclictest1583188-21kworker/u16:5+events_unbound07:33:015
1105947992422,2cyclictest1531093-21kworker/u16:1+events_unbound07:16:265
1105947992422,2cyclictest1490525-21kworker/u16:0+events_unbound07:03:505
1105947992422,2cyclictest1459720-21kworker/u16:2+events_unbound06:49:425
1105947992422,2cyclictest1308799-21kworker/u16:0+events_unbound05:24:355
1105947992422,2cyclictest1268883-21kworker/u16:5+events_unbound05:35:185
1105947992421,2cyclictest1737257-21kworker/u16:5+events_unbound08:46:445
1105945992422,2cyclictest1583188-21kworker/u16:5+events_unbound07:44:214
1105945992422,2cyclictest1460118-21kworker/u16:3+flush-8:006:41:394
1105945992422,2cyclictest1253038-21kworker/u16:4+events_unbound04:57:534
1105945992422,2cyclictest1253038-21kworker/u16:4+events_unbound04:57:534
1105945992422,2cyclictest1181966-21kworker/u16:0+events_unbound04:37:534
1105945992421,2cyclictest1490525-21kworker/u16:0+flush-8:007:06:544
1105945992421,2cyclictest1325185-21kworker/u16:1+events_unbound05:31:454
1105955992322,0cyclictest0-21swapper/708:31:027
1105955992322,0cyclictest0-21swapper/703:50:227
1105955992320,2cyclictest1180796-21ntpq04:07:077
1105950992320,2cyclictest352228-21kworker/u16:1+flush-8:003:42:046
1105947992321,2cyclictest829632-21kworker/u16:2+events_unbound03:54:385
1105947992321,2cyclictest829632-21kworker/u16:2+events_unbound03:43:495
1105947992321,2cyclictest1706820-21kworker/u16:0+flush-8:008:22:565
1105947992321,2cyclictest1706820-21kworker/u16:0+events_unbound08:29:145
1105947992321,2cyclictest1531093-21kworker/u16:1+events_unbound07:26:265
1105947992321,2cyclictest1459720-21kworker/u16:2+events_unbound06:33:505
1105947992321,2cyclictest1459720-21kworker/u16:2+events_unbound06:33:505
1105947992321,2cyclictest1388110-21kworker/u16:0+events_unbound05:59:095
1105947992321,2cyclictest1253038-21kworker/u16:4+events_unbound04:53:455
1105947992320,2cyclictest1157379-21kworker/u16:4+events_unbound04:26:525
1105945992320,2cyclictest1308799-21kworker/u16:0+flush-8:005:42:024
1105955992221,0cyclictest0-21swapper/708:45:067
1105955992221,0cyclictest0-21swapper/707:48:417
1105955992221,0cyclictest0-21swapper/704:48:147
1105955992221,0cyclictest0-21swapper/704:40:067
110595599220,21cyclictest1501123-21latency_hist06:46:447
1105950992220,2cyclictest1737257-21kworker/u16:5+flush-8:008:57:016
1105950992219,2cyclictest1623868-21kworker/u16:4+events_unbound07:47:016
1105947992220,2cyclictest1583188-21kworker/u16:5+events_unbound08:04:045
1105947992220,2cyclictest1490525-21kworker/u16:0+flush-8:007:19:375
1105947992220,2cyclictest1490525-21kworker/u16:0+flush-8:007:19:375
1105947992220,2cyclictest1490525-21kworker/u16:0+events_unbound07:07:585
1105947992220,2cyclictest1377283-21kworker/u16:3+events_unbound05:48:575
1105947992220,2cyclictest1308799-21kworker/u16:0+events_unbound05:21:305
1105947992220,2cyclictest1268883-21kworker/u16:5+events_unbound05:11:065
1105947992219,2cyclictest1268883-21kworker/u16:5+events_unbound05:41:475
1105945992220,2cyclictest1654995-21kworker/u16:2+events_unbound09:00:524
1105945992220,2cyclictest1460118-21kworker/u16:3+flush-8:007:12:224
1105945992220,2cyclictest1308799-21kworker/u16:0+events_unbound05:40:544
1105945992220,2cyclictest1181966-21kworker/u16:0+events_unbound04:29:544
1105945992219,2cyclictest1469265-21kworker/u16:5+flush-8:006:46:534
1105945992219,2cyclictest1141350-21kworker/u16:1+events_unbound04:12:014
1105945992219,2cyclictest1104752-21kworker/u16:0+flush-8:003:51:544
1105955992120,0cyclictest0-21swapper/706:59:017
1105950992119,2cyclictest1636989-21kworker/u16:1+flush-8:007:52:046
1105947992119,2cyclictest1706820-21kworker/u16:0+events_unbound08:45:455
1105947992119,2cyclictest1325185-21kworker/u16:1+events_unbound05:55:385
1105945992119,2cyclictest829632-21kworker/u16:2+flush-8:003:46:594
1105945992119,2cyclictest1706820-21kworker/u16:0+flush-8:008:56:434
1105945992119,2cyclictest1531093-21kworker/u16:1+events_unbound07:27:074
1105945992119,2cyclictest1388110-21kworker/u16:0+events_unbound06:21:024
1105955992020,0cyclictest0-21swapper/706:37:457
1105947992018,2cyclictest1441590-21kworker/u16:4+events_unbound06:23:255
1105945992018,2cyclictest1273525-21kworker/u16:6+events_unbound05:02:134
1105945992017,2cyclictest1583188-21kworker/u16:5+flush-8:008:21:534
1105945992017,2cyclictest1531093-21kworker/u16:1+events_unbound07:17:024
1105945992017,2cyclictest1531093-21kworker/u16:1+events_unbound07:17:024
1105955991918,0cyclictest0-21swapper/708:54:137
1105955991918,0cyclictest0-21swapper/705:41:187
1105955991918,0cyclictest0-21swapper/705:33:377
1105955991918,0cyclictest0-21swapper/705:05:137
1105955991918,0cyclictest0-21swapper/704:03:317
1105950991917,2cyclictest829632-21kworker/u16:2+flush-8:004:07:026
1105950991916,2cyclictest1268883-21kworker/u16:5+flush-8:005:17:056
1105947991917,2cyclictest1654995-21kworker/u16:2+events_unbound08:19:345
1105947991917,2cyclictest1273525-21kworker/u16:6+events_unbound05:00:065
1105947991917,2cyclictest1273525-21kworker/u16:6+events_unbound05:00:065
1105947991917,2cyclictest1157379-21kworker/u16:4+events_unbound04:05:135
1105945991917,2cyclictest1707865-21kworker/u16:1+events_unbound08:47:054
1105945991917,2cyclictest1377283-21kworker/u16:3+flush-8:005:46:534
1105945991916,2cyclictest1490525-21kworker/u16:0+flush-8:007:02:054
1105955991817,0cyclictest0-21swapper/707:34:337
1105955991817,0cyclictest0-21swapper/706:50:467
1105955991817,0cyclictest0-21swapper/706:33:427
1105955991817,0cyclictest0-21swapper/706:33:427
1105955991817,0cyclictest0-21swapper/706:18:537
1105955991817,0cyclictest0-21swapper/704:58:187
1105955991817,0cyclictest0-21swapper/704:58:187
1105955991817,0cyclictest0-21swapper/704:29:037
1105955991817,0cyclictest0-21swapper/704:17:307
1105945991816,2cyclictest829632-21kworker/u16:2+events_unbound04:06:194
1105945991816,2cyclictest1583188-21kworker/u16:5+events_unbound08:17:034
1105945991816,2cyclictest1325185-21kworker/u16:1+flush-8:006:21:534
1105945991816,2cyclictest1308799-21kworker/u16:0+events_unbound05:22:174
1105945991816,2cyclictest1268883-21kworker/u16:5+events_unbound06:01:024
1105945991816,2cyclictest1181966-21kworker/u16:0+events_unbound04:48:554
1105955991716,0cyclictest0-21swapper/708:48:087
1105955991716,0cyclictest0-21swapper/708:03:217
1105955991716,0cyclictest0-21swapper/707:41:167
1105955991716,0cyclictest0-21swapper/707:16:017
1105955991716,0cyclictest0-21swapper/706:01:227
1105955991716,0cyclictest0-21swapper/705:50:007
1105955991715,1cyclictest0-21swapper/708:37:377
1105955991715,1cyclictest0-21swapper/707:31:417
1105950991715,2cyclictest1157379-21kworker/u16:4+events_unbound04:16:436
1105950991714,3cyclictest1490525-21kworker/u16:0+flush-8:007:21:436
1105950991714,3cyclictest1490525-21kworker/u16:0+flush-8:007:21:436
1105950991714,2cyclictest1490525-21kworker/u16:0+events_unbound07:01:576
1105950991712,4cyclictest1387157-21smart_sda05:47:136
1105955991615,0cyclictest0-21swapper/709:05:087
1105955991615,0cyclictest0-21swapper/708:09:107
110595599160,15cyclictest1313-21snmpd06:13:177
1105950991614,2cyclictest1141350-21kworker/u16:1+events_unbound04:01:386
1105945991614,2cyclictest1636989-21kworker/u16:1+events_unbound08:07:544
1105945991614,2cyclictest1595135-21kworker/u16:3+events_unbound07:39:534
1105945991612,3cyclictest1636989-21kworker/u16:1+events_unbound07:57:054
155244921513,1sleep70-21swapper/707:09:117
1105955991514,0cyclictest0-21swapper/708:20:177
1105955991514,0cyclictest0-21swapper/706:54:257
1105955991514,0cyclictest0-21swapper/705:46:297
1105955991514,0cyclictest0-21swapper/705:30:067
1105955991514,0cyclictest0-21swapper/705:23:587
1105955991514,0cyclictest0-21swapper/705:07:307
1105955991514,0cyclictest0-21swapper/703:58:307
1105955991513,1cyclictest1326120-21cat05:21:447
1105955991512,2cyclictest1274481-21munin-run04:56:437
1105950991513,2cyclictest1706820-21kworker/u16:0+flush-8:008:47:036
110595099150,14cyclictest0-21swapper/607:31:576
1105945991513,2cyclictest1706820-21kworker/u16:0+flush-8:008:37:164
1105945991513,2cyclictest1706820-21kworker/u16:0+events_unbound09:06:224
1105945991513,2cyclictest1469265-21kworker/u16:5+events_unbound06:36:214
1105945991513,2cyclictest1469265-21kworker/u16:5+events_unbound06:36:214
1105945991513,2cyclictest1460118-21kworker/u16:3+events_unbound06:42:034
1105945991513,2cyclictest1419483-21kworker/u16:2+flush-8:006:12:444
1105945991512,2cyclictest1116294-21kworker/u16:3+flush-8:003:41:504
1105955991412,1cyclictest1315667-21awk05:16:447
1105950991412,2cyclictest1116294-21kworker/u16:3+flush-8:003:51:456
110595099140,1cyclictest0-21swapper/608:40:226
1105945991412,2cyclictest1707865-21kworker/u16:1+events_unbound08:28:534
1105945991412,2cyclictest1116294-21kworker/u16:3+flush-8:003:57:054
1105955991312,0cyclictest0-21swapper/704:42:507
110595599130,11cyclictest1313-21snmpd06:23:247
1105950991311,2cyclictest1707865-21kworker/u16:1+flush-8:008:52:066
1105950991311,2cyclictest1460118-21kworker/u16:3+flush-8:006:41:596
1105950991310,3cyclictest1490525-21kworker/u16:0+flush-8:007:07:006
1105950991310,2cyclictest1157379-21kworker/u16:4+flush-8:004:21:586
110595099130,13cyclictest0-21swapper/605:09:456
1105945991311,2cyclictest1636989-21kworker/u16:1+events_unbound08:16:224
1105950991211,1cyclictest0-21swapper/605:02:306
1105950991210,2cyclictest829632-21kworker/u16:2+events_unbound04:32:016
1105950991210,2cyclictest1469265-21kworker/u16:5+events_unbound06:57:136
110595099120,1cyclictest0-21swapper/606:20:326
110595099120,12cyclictest0-21swapper/606:34:346
110595099120,12cyclictest0-21swapper/606:34:346
1105945991211,1cyclictest0-21swapper/404:25:534
1105945991211,1cyclictest0-21swapper/404:18:194
1105945991210,2cyclictest1469265-21kworker/u16:5+flush-8:006:52:024
1105945991210,2cyclictest1419483-21kworker/u16:2+events_unbound06:08:454
1105945991210,2cyclictest1388110-21kworker/u16:0+events_unbound06:04:454
1105945991210,2cyclictest1181966-21kworker/u16:0+events_unbound04:42:134
1105945991210,2cyclictest1181966-21kworker/u16:0+events_unbound04:35:544
110595099119,2cyclictest1388110-21kworker/u16:0+flush-8:006:07:136
110595099119,1cyclictest0-21swapper/604:41:596
110595099112,8cyclictest0-21swapper/608:01:596
1105950991110,1cyclictest0-21swapper/604:17:446
1105945991110,1cyclictest0-21swapper/408:04:324
1105945991110,1cyclictest0-21swapper/407:24:204
110594599110,1cyclictest0-21swapper/405:16:294
110595099109,1cyclictest0-21swapper/607:38:256
110595099109,1cyclictest0-21swapper/606:37:246
110595099107,2cyclictest1654995-21kworker/u16:2+flush-8:009:01:596
110595099105,4cyclictest1409986-21cat06:01:596
11059509998,1cyclictest0-21swapper/606:49:236
11059509990,8cyclictest0-21swapper/608:11:596
11059509987,1cyclictest0-21swapper/604:49:166
11059509986,2cyclictest1583188-21kworker/u16:5+flush-8:007:42:066
11059509986,2cyclictest1308799-21kworker/u16:0+flush-8:005:12:056
11059509985,2cyclictest0-21swapper/605:52:046
11059509984,3cyclictest1687938-21tune2fs08:16:576
11059509984,3cyclictest1574468-21cut07:21:586
11059509983,4cyclictest1348008-21gltestperf05:31:596
11059509982,2cyclictest681rcuog/403:37:066
11059459984,3cyclictest1107546-21tr03:37:004
11059559970,6cyclictest1727908-21cron08:36:457
11059509976,1cyclictest0-21swapper/608:26:496
11059509975,1cyclictest0-21swapper/608:07:136
11059509973,3cyclictest1369230-21kthreadcore05:42:026
11059509950,4cyclictest1727859-21updatedb08:36:456
11059459930,1cyclictest991rcuop/708:36:454
11059479910,1cyclictest0-21swapper/508:36:455
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional