You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-08-21 - 22:10
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot2.osadl.org (updated Thu Aug 21, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1067898996563,2cyclictest1258454-21kworker/u16:6+flush-8:017:03:186
106735025646,7sleep60-21swapper/615:26:396
106757125545,7sleep40-21swapper/415:29:424
106727325141,7sleep50-21swapper/515:25:335
1067900994944,4cyclictest589235-21systemd-journal17:02:117
1067898994543,2cyclictest1474106-21kworker/u16:3+events_unbound18:55:536
1067893994340,2cyclictest1464988-21kworker/u16:0+flush-8:019:09:445
10674082417,30sleep70-21swapper/715:27:287
1067900994039,0cyclictest0-21swapper/719:35:127
1067900994039,0cyclictest0-21swapper/719:29:457
1067900994039,0cyclictest0-21swapper/719:29:457
1067900994039,0cyclictest0-21swapper/716:05:187
1067900994037,2cyclictest1493950-21smart_sda19:00:127
1067900993938,0cyclictest0-21swapper/719:43:057
1067898993937,2cyclictest1552649-21kworker/u16:5+flush-8:020:55:106
1067886993734,2cyclictest1091205-21kworker/u16:5+flush-8:016:24:444
1067898993634,2cyclictest1661143-21kworker/u16:4+events_unbound20:28:046
1067898993634,2cyclictest1130575-21kworker/u16:1+events_unbound16:41:286
1067898993633,2cyclictest359591-21kworker/u16:3+events_unbound15:29:546
1067898993533,2cyclictest1228459-21kworker/u16:2+events_unbound17:07:236
1067893993533,2cyclictest1203902-21kworker/u16:3+events_unbound17:02:115
1067886993533,2cyclictest1513996-21kworker/u16:2+flush-8:020:11:044
1067898993331,2cyclictest1357378-21kworker/u16:0+events_unbound17:54:066
1067898993331,2cyclictest1278786-21kworker/u16:3+events_unbound18:14:066
1067886993331,2cyclictest1258453-21kworker/u16:5+flush-8:017:05:074
1067900993228,3cyclictest589235-21systemd-journal18:14:447
1067900993227,4cyclictest1445695-21latency_hist18:39:447
1067900993226,5cyclictest1612496-21latency_hist20:04:437
1067898993230,2cyclictest1661143-21kworker/u16:4+flush-8:020:45:076
1067898993230,2cyclictest1513996-21kworker/u16:2+events_unbound19:59:536
1067898993230,2cyclictest1376739-21kworker/u16:1+events_unbound18:07:076
1067898993230,2cyclictest1338266-21kworker/u16:1+flush-8:017:48:066
1067886993229,2cyclictest1110933-21kworker/u16:0+flush-8:015:55:294
1067898993129,2cyclictest1640969-21kworker/u16:0+flush-8:020:18:146
1067898993129,2cyclictest1640969-21kworker/u16:0+flush-8:020:18:146
1067898993129,2cyclictest1386735-21kworker/u16:4+flush-8:018:43:076
1067898993129,2cyclictest1317216-21kworker/u16:2+events_unbound18:35:086
1067898993129,2cyclictest1278786-21kworker/u16:3+flush-8:017:23:096
1067898993129,2cyclictest1145148-21kworker/u16:0+events_unbound16:59:056
1067898993128,2cyclictest1091205-21kworker/u16:5+flush-8:015:44:466
10814922300,1chrt27174-21gnome-shell15:34:487
1067900993029,0cyclictest0-21swapper/716:15:147
1067898993028,2cyclictest1534349-21kworker/u16:4+flush-8:019:37:096
1067898993028,2cyclictest1278786-21kworker/u16:3+flush-8:017:33:466
1067898993028,2cyclictest1278786-21kworker/u16:3+events_unbound17:40:296
1067898993028,2cyclictest1184169-21kworker/u16:2+flush-8:016:29:546
1067898993028,2cyclictest1145148-21kworker/u16:0+flush-8:016:48:576
1067898993028,2cyclictest1067348-21kworker/u16:4+flush-8:015:52:076
1067898993027,2cyclictest1376739-21kworker/u16:1+flush-8:018:29:486
1067886993028,2cyclictest1257222-21kworker/u16:4+flush-8:017:02:204
1067898992927,2cyclictest1671365-21kworker/u16:2+events_unbound20:38:546
1067898992927,2cyclictest1474106-21kworker/u16:3+flush-8:019:15:596
1067898992927,2cyclictest1464988-21kworker/u16:0+flush-8:019:09:396
1067898992927,2cyclictest1145148-21kworker/u16:0+events_unbound17:11:416
1067898992927,2cyclictest1067348-21kworker/u16:4+events_unbound16:02:056
1067886992927,2cyclictest1317216-21kworker/u16:2+events_unbound17:35:064
1067900992827,0cyclictest0-21swapper/717:39:397
106790099280,26cyclictest4184977-17auditd16:42:057
1067898992826,2cyclictest1583298-21kworker/u16:1+flush-8:019:57:486
1067898992826,2cyclictest1553233-21kworker/u16:6+flush-8:019:33:136
1067898992826,2cyclictest1553233-21kworker/u16:6+flush-8:019:33:136
1067898992826,2cyclictest1513996-21kworker/u16:2+events_unbound19:50:526
1067898992826,2cyclictest1317216-21kworker/u16:2+events_unbound18:02:146
1067898992826,2cyclictest1184169-21kworker/u16:2+events_unbound16:36:076
1067898992826,2cyclictest1067348-21kworker/u16:4+flush-8:015:37:376
1067898992725,2cyclictest1513996-21kworker/u16:2+flush-8:019:47:136
1067898992725,2cyclictest1376739-21kworker/u16:1+events_unbound19:00:136
1067898992725,2cyclictest1357449-21kworker/u16:4+flush-8:017:59:156
1067898992725,2cyclictest1317216-21kworker/u16:2+events_unbound17:37:136
1067898992725,2cyclictest1067348-21kworker/u16:4+events_unbound16:16:546
1067886992725,2cyclictest1464988-21kworker/u16:0+flush-8:019:35:144
1067886992724,2cyclictest1434917-21kworker/u16:5+events_unbound18:39:444
1067900992625,0cyclictest0-21swapper/717:32:057
1067900992625,0cyclictest0-21swapper/717:24:457
1067898992624,2cyclictest1593262-21kworker/u16:3+events_unbound20:07:446
1067898992624,2cyclictest1513996-21kworker/u16:2+flush-8:020:23:156
1067898992624,2cyclictest1376739-21kworker/u16:1+events_unbound18:23:176
1067898992624,2cyclictest1228459-21kworker/u16:2+events_unbound16:52:466
1067898992624,2cyclictest1067348-21kworker/u16:4+flush-8:016:06:586
1067898992624,2cyclictest1046260-21kworker/u16:2+events_unbound15:43:026
1067898992623,2cyclictest1317216-21kworker/u16:2+flush-8:018:24:496
1067886992624,2cyclictest1552649-21kworker/u16:5+events_unbound19:40:194
1067900992524,0cyclictest0-21swapper/719:05:567
1067898992523,2cyclictest1474106-21kworker/u16:3+flush-8:019:12:246
1067898992523,2cyclictest1145148-21kworker/u16:0+flush-8:017:27:576
1067898992523,2cyclictest1091205-21kworker/u16:5+events_unbound15:58:186
1067898992522,2cyclictest1317216-21kworker/u16:2+events_unbound18:49:466
1067893992522,3cyclictest1434917-21kworker/u16:5+flush-8:019:01:255
1067886992523,2cyclictest1464988-21kworker/u16:0+events_unbound19:45:024
1067886992522,2cyclictest1228459-21kworker/u16:2+flush-8:016:54:584
1067898992422,2cyclictest1130575-21kworker/u16:1+flush-8:016:13:376
1067898992422,2cyclictest1067348-21kworker/u16:4+flush-8:016:24:106
1067900992320,2cyclictest1700729-21munin-run20:49:437
1067898992321,2cyclictest1552649-21kworker/u16:5+events_unbound19:41:586
1067898992321,2cyclictest1524550-21kworker/u16:1+flush-8:019:25:126
1067898992321,2cyclictest1376739-21kworker/u16:1+flush-8:018:47:096
1067898992321,2cyclictest1376739-21kworker/u16:1+flush-8:018:47:096
1067886992319,3cyclictest1524550-21kworker/u16:1+flush-8:019:25:034
1067900992220,1cyclictest0-21swapper/717:04:597
1067898992220,2cyclictest1552649-21kworker/u16:5+events_unbound20:32:436
1067898992220,2cyclictest1184169-21kworker/u16:2+events_unbound16:29:076
1067898992219,2cyclictest1278786-21kworker/u16:3+events_unbound17:14:476
1067886992220,2cyclictest1046260-21kworker/u16:2+flush-8:015:44:064
1067886992219,2cyclictest1317216-21kworker/u16:2+flush-8:017:49:594
1067900992119,1cyclictest1195769-21kthreadcore16:30:057
106790099210,19cyclictest1313-21snmpd17:18:207
1067893992118,2cyclictest1317216-21kworker/u16:2+flush-8:017:59:575
1067886992119,2cyclictest1583298-21kworker/u16:1+events_unbound20:15:044
1067886992119,2cyclictest1583298-21kworker/u16:1+events_unbound20:15:044
1067886992118,2cyclictest1464988-21kworker/u16:0+flush-8:018:57:404
1067886992118,2cyclictest1067348-21kworker/u16:4+flush-8:015:39:374
1067900992019,0cyclictest0-21swapper/718:29:467
1067900992018,1cyclictest1278912-21awk17:14:447
1067900992015,4cyclictest589235-21systemd-journal19:12:057
1067898992018,2cyclictest1661143-21kworker/u16:4+events_unbound20:44:116
1067898992018,2cyclictest1278786-21kworker/u16:3+flush-8:018:15:186
1067886992018,2cyclictest1593262-21kworker/u16:3+events_unbound19:54:584
1067886992018,2cyclictest1258453-21kworker/u16:5+events_unbound17:17:374
1067886992017,3cyclictest1228459-21kworker/u16:2+flush-8:016:50:164
1067886992017,2cyclictest1464988-21kworker/u16:0+flush-8:018:49:574
1067900991918,0cyclictest0-21swapper/720:53:367
1067900991915,3cyclictest589235-21systemd-journal17:59:047
106790099190,17cyclictest0-21swapper/716:10:087
1067898991917,2cyclictest1513996-21kworker/u16:2+flush-8:020:11:536
1067893991917,2cyclictest1278810-21kworker/u16:4+flush-8:017:19:595
1067886991917,2cyclictest1552649-21kworker/u16:5+flush-8:020:58:534
1067886991917,2cyclictest1376739-21kworker/u16:1+flush-8:018:35:534
1067886991917,2cyclictest1317216-21kworker/u16:2+events_unbound18:29:054
1067900991817,0cyclictest0-21swapper/720:20:017
1067900991817,0cyclictest0-21swapper/719:25:007
1067900991816,1cyclictest0-21swapper/716:35:007
106790099180,16cyclictest589235-21systemd-journal19:45:057
1067893991816,2cyclictest1513996-21kworker/u16:2+events_unbound20:14:585
1067893991816,2cyclictest1513996-21kworker/u16:2+events_unbound20:14:585
1067893991815,2cyclictest1278786-21kworker/u16:3+flush-8:018:04:595
1067886991816,2cyclictest1317216-21kworker/u16:2+flush-8:018:45:104
1067886991816,2cyclictest1317216-21kworker/u16:2+flush-8:018:45:104
1067886991815,2cyclictest1145148-21kworker/u16:0+flush-8:017:25:004
1067900991715,1cyclictest0-21swapper/718:00:337
1067900991713,2cyclictest1602700-21munin-run19:59:447
1067898991715,2cyclictest1583298-21kworker/u16:1+flush-8:020:53:096
1067886991715,2cyclictest1474106-21kworker/u16:3+flush-8:019:04:594
1067886991715,2cyclictest1278786-21kworker/u16:3+flush-8:018:15:154
1067886991715,2cyclictest1145148-21kworker/u16:0+flush-8:017:41:064
1067886991714,2cyclictest1583298-21kworker/u16:1+flush-8:020:48:354
106790099168,7cyclictest0-21swapper/715:45:057
1067900991616,0cyclictest0-21swapper/720:29:287
1067900991612,3cyclictest1313-21snmpd16:04:457
1067898991614,2cyclictest1474106-21kworker/u16:3+flush-8:019:20:376
1067886991614,2cyclictest1474106-21kworker/u16:3+events_unbound19:09:594
1067900991514,0cyclictest0-21swapper/720:36:017
1067900991514,0cyclictest0-21swapper/719:15:027
1067900991514,0cyclictest0-21swapper/715:53:417
1067900991513,1cyclictest0-21swapper/718:50:147
1067900991512,2cyclictest0-21swapper/716:54:457
1067886991513,2cyclictest1524550-21kworker/u16:1+events_unbound19:20:074
1067886991512,2cyclictest1357449-21kworker/u16:4+flush-8:017:55:004
106788699150,14cyclictest0-21swapper/420:40:104
1067900991413,0cyclictest0-21swapper/720:55:047
1067900991412,1cyclictest0-21swapper/719:50:037
106790099140,1cyclictest0-21swapper/718:25:097
1067893991410,3cyclictest1067348-21kworker/u16:4+flush-8:015:35:095
1067886991412,2cyclictest1552649-21kworker/u16:5+events_unbound20:38:334
1067886991412,2cyclictest1067348-21kworker/u16:4+flush-8:016:10:104
1067886991411,3cyclictest1130575-21kworker/u16:1+flush-8:016:31:114
106788699140,1cyclictest0-21swapper/415:30:004
106790099139,3cyclictest0-21swapper/720:09:437
106790099136,6cyclictest27394-21gmain20:15:007
106790099136,6cyclictest27394-21gmain20:15:007
106790099136,6cyclictest0-21swapper/718:17:047
1067900991313,0cyclictest0-21swapper/716:47:067
1067900991310,2cyclictest0-21swapper/718:05:077
106790099130,12cyclictest1313-21snmpd17:44:357
1067893991311,2cyclictest1671365-21kworker/u16:2+flush-8:020:44:595
1067893991311,2cyclictest1145148-21kworker/u16:0+flush-8:017:05:475
106789399130,12cyclictest0-21swapper/517:24:525
106789399130,0cyclictest0-21swapper/519:59:595
1067886991311,2cyclictest1513996-21kworker/u16:2+flush-8:020:08:124
1067886991311,2cyclictest1376739-21kworker/u16:1+events_unbound18:08:064
1067886991311,2cyclictest1184169-21kworker/u16:2+events_unbound16:35:124
106790099129,2cyclictest1313-21snmpd18:44:107
106790099129,2cyclictest1313-21snmpd17:51:447
106790099129,2cyclictest1313-21snmpd16:22:427
106790099128,3cyclictest1313-21snmpd15:40:267
106789399128,3cyclictest1280064-21cat17:15:015
1067893991211,1cyclictest0-21swapper/519:31:275
1067893991211,1cyclictest0-21swapper/519:31:275
1067893991211,1cyclictest0-21swapper/516:42:375
1067893991211,1cyclictest0-21swapper/516:09:405
1067893991210,2cyclictest1317216-21kworker/u16:2+flush-8:018:30:155
106789399120,1cyclictest0-21swapper/520:28:125
106789399120,1cyclictest0-21swapper/518:35:295
106789399120,1cyclictest0-21swapper/518:15:565
106789399120,1cyclictest0-21swapper/517:48:595
106789399120,12cyclictest0-21swapper/520:35:185
106789399120,10cyclictest0-21swapper/516:45:025
106788699129,2cyclictest1425090-21kworker/u16:0+flush-8:018:29:584
1067886991211,1cyclictest0-21swapper/419:16:084
1067886991210,2cyclictest1228459-21kworker/u16:2+events_unbound17:10:074
1067886991210,2cyclictest1145148-21kworker/u16:0+flush-8:016:45:004
1067886991210,2cyclictest1130575-21kworker/u16:1+flush-8:016:00:154
106788699120,1cyclictest0-21swapper/420:52:554
106788699120,1cyclictest0-21swapper/417:47:414
106788699120,1cyclictest0-21swapper/416:29:204
106788699120,12cyclictest0-21swapper/415:54:214
106790099118,2cyclictest1313-21snmpd20:31:307
106790099118,2cyclictest1313-21snmpd20:09:517
106790099118,2cyclictest1313-21snmpd18:57:167
106790099118,2cyclictest1313-21snmpd18:44:467
106790099118,2cyclictest1313-21snmpd18:44:467
106790099117,3cyclictest27924-21gmain17:45:047
106790099117,3cyclictest27904-21gmain20:40:047
106790099117,3cyclictest27394-21gmain19:20:007
106790099115,5cyclictest27204-21gmain15:31:247
106790099114,6cyclictest27904-21gmain15:55:127
106790099110,10cyclictest1189558-21turbostat16:29:447
106789399116,4cyclictest1505748-21cat19:10:005
106789399114,7cyclictest0-21swapper/518:13:325
1067893991110,1cyclictest0-21swapper/518:55:595
1067893991110,1cyclictest0-21swapper/518:51:065
1067893991110,1cyclictest0-21swapper/518:46:125
1067893991110,1cyclictest0-21swapper/518:46:125
1067893991110,1cyclictest0-21swapper/518:26:305
1067893991110,1cyclictest0-21swapper/516:20:235
1067893991110,1cyclictest0-21swapper/516:02:535
1067893991110,1cyclictest0-21swapper/515:52:105
106789399110,11cyclictest0-21swapper/520:43:205
106789399110,11cyclictest0-21swapper/516:51:175
106789399110,11cyclictest0-21swapper/515:58:005
106789399110,0cyclictest0-21swapper/517:58:175
106788699119,2cyclictest1640969-21kworker/u16:0+flush-8:020:20:244
106788699119,2cyclictest1593262-21kworker/u16:3+flush-8:020:01:024
106788699119,2cyclictest1552649-21kworker/u16:5+events_unbound20:30:074
106788699119,2cyclictest1317216-21kworker/u16:2+events_unbound18:00:114
106788699119,2cyclictest1067348-21kworker/u16:4+events_unbound15:44:594
106788699117,3cyclictest1464988-21kworker/u16:0+flush-8:019:30:094
106788699117,3cyclictest1464988-21kworker/u16:0+flush-8:019:30:094
1067886991110,1cyclictest0-21swapper/417:21:414
1067886991110,1cyclictest0-21swapper/416:41:574
106788699110,11cyclictest0-21swapper/420:28:484
106788699110,11cyclictest0-21swapper/418:12:174
106790099106,3cyclictest1234149-21sshd-session16:50:047
106790099100,9cyclictest1313-21snmpd18:21:277
106790099100,2cyclictest0-21swapper/717:20:137
106789399109,1cyclictest0-21swapper/520:58:285
106789399109,1cyclictest0-21swapper/520:07:435
106789399109,1cyclictest0-21swapper/519:55:445
106789399109,1cyclictest0-21swapper/519:53:315
106789399109,1cyclictest0-21swapper/517:50:435
106789399109,1cyclictest0-21swapper/517:40:385
106789399109,1cyclictest0-21swapper/515:30:255
106789399108,2cyclictest1534349-21kworker/u16:4+flush-8:019:25:145
106789399106,3cyclictest1180936-21cat16:25:015
106788699100,0cyclictest0-21swapper/416:14:504
10678939998,1cyclictest0-21swapper/520:23:575
10678939998,1cyclictest0-21swapper/519:48:105
10678939998,1cyclictest0-21swapper/519:16:285
10678939998,1cyclictest0-21swapper/518:20:505
10678939998,1cyclictest0-21swapper/517:38:065
10678939998,1cyclictest0-21swapper/515:47:175
10678939998,1cyclictest0-21swapper/515:44:175
10678939996,3cyclictest1203902-21kworker/u16:3+flush-8:016:35:155
10678939996,2cyclictest0-21swapper/519:35:055
10678869998,1cyclictest0-21swapper/419:00:314
10678869996,2cyclictest1415213-21needreboot18:20:104
10678869996,2cyclictest1130575-21kworker/u16:1+events_unbound16:05:034
10678869995,3cyclictest1278786-21kworker/u16:3+flush-8:017:31:184
10678939987,1cyclictest0-21swapper/519:42:205
10678939987,1cyclictest0-21swapper/517:31:105
10678939986,1cyclictest0-21swapper/519:20:055
10678939983,4cyclictest1446651-21cut18:39:585
10678939983,4cyclictest1277834-21missed_timers17:10:075
10678939980,3cyclictest0-21swapper/520:10:005
10678939973,3cyclictest1703160-21cut20:50:025
10678939973,3cyclictest1664523-21grep20:30:015
10678939973,3cyclictest1190044-21cpuspeed_turbos16:29:575
10678939973,3cyclictest1160798-21cat16:14:575
10678939973,3cyclictest1150963-21wc16:09:575
10678939972,4cyclictest1240655-21cut16:55:015
10678869973,3cyclictest1586053-21cut19:50:014
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional