You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-22 - 18:33
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Sat Nov 22, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
58486726048,8sleep50-21swapper/515:23:145
585270995651,4cyclictest983421-21latency_hist18:38:307
58468425318,31sleep70-21swapper/715:20:437
585260995250,2cyclictest1033867-21kworker/u16:0+events_unbound19:03:564
585270995146,4cyclictest670018-21latency_hist16:03:317
585260995048,2cyclictest659689-21kworker/u16:0+events_unbound16:21:144
58461524938,8sleep40-21swapper/415:19:444
58527099470,45cyclictest993575-21latency_hist18:43:317
585260994745,2cyclictest594956-21kworker/u16:3+flush-8:015:30:144
57524924736,7sleep60-21swapper/615:18:346
585266994644,2cyclictest667510-21kworker/u16:4+events_unbound16:25:136
585266994643,2cyclictest690033-21kworker/u16:1+events_unbound16:13:336
585260994644,2cyclictest832218-21kworker/u16:3+events_unbound17:44:004
585266994442,2cyclictest771056-21kworker/u16:5+events_unbound17:13:136
585260994441,2cyclictest1154788-21kworker/u16:0+events_unbound20:23:444
585266994341,2cyclictest3366955-21kworker/u16:5+events_unbound15:24:146
585266994341,2cyclictest1114441-21kworker/u16:3+events_unbound20:13:136
585270994237,3cyclictest589235-21systemd-journal16:08:317
585270994236,5cyclictest912579-21latency_hist18:03:317
585266994240,2cyclictest821765-21kworker/u16:2+events_unbound18:08:146
585260994240,2cyclictest832218-21kworker/u16:3+events_unbound17:25:104
585260994240,2cyclictest730323-21kworker/u16:2+flush-8:016:33:334
585260994139,2cyclictest821765-21kworker/u16:2+events_unbound17:40:454
585270994035,4cyclictest589235-21systemd-journal16:46:137
585270994034,5cyclictest659931-21latency_hist15:58:317
585270994034,5cyclictest1054177-21latency_hist19:13:317
585266994038,2cyclictest972984-21kworker/u16:1+flush-8:019:08:306
585266993937,2cyclictest1114441-21kworker/u16:3+flush-8:019:44:296
585266993836,2cyclictest832218-21kworker/u16:3+events_unbound17:43:136
585266993836,2cyclictest821765-21kworker/u16:2+flush-8:018:09:136
585266993836,2cyclictest659689-21kworker/u16:0+events_unbound16:36:136
585260993835,3cyclictest871947-21kworker/u16:1+flush-8:018:13:134
585266993735,2cyclictest667510-21kworker/u16:4+events_unbound16:53:316
585266993734,2cyclictest821765-21kworker/u16:2+flush-8:017:43:336
585266993734,2cyclictest690033-21kworker/u16:1+events_unbound16:43:336
585261993735,2cyclictest667510-21kworker/u16:4+flush-8:016:23:495
585260993734,2cyclictest1084177-21kworker/u16:1+events_unbound19:33:344
585266993634,2cyclictest554576-21kworker/u16:1+flush-8:015:34:036
585261993633,2cyclictest1136119-21kworker/u16:2+events_unbound20:23:485
585260993634,2cyclictest832218-21kworker/u16:3+flush-8:018:20:124
585260993633,2cyclictest972984-21kworker/u16:1+flush-8:018:33:414
585260993633,2cyclictest649558-21kworker/u16:1+flush-8:015:58:344
585266993533,2cyclictest659689-21kworker/u16:0+events_unbound16:57:146
585260993533,2cyclictest1084177-21kworker/u16:1+flush-8:019:33:304
585260993533,2cyclictest1074040-21kworker/u16:0+events_unbound19:24:004
585266993432,2cyclictest667510-21kworker/u16:4+flush-8:017:08:226
585266993432,2cyclictest1154788-21kworker/u16:0+events_unbound20:02:146
585266993432,2cyclictest1013444-21kworker/u16:3+events_unbound18:54:156
585261993432,2cyclictest972984-21kworker/u16:1+events_unbound18:53:565
585260993432,2cyclictest700418-21kworker/u16:3+events_unbound16:28:144
585270993327,5cyclictest589235-21systemd-journal18:29:537
585266993331,2cyclictest932747-21kworker/u16:4+events_unbound18:27:076
585266993331,2cyclictest832218-21kworker/u16:3+events_unbound18:17:416
585266993331,2cyclictest584119-21kworker/u16:0+events_unbound15:41:366
585261993331,2cyclictest1124677-21kworker/u16:1+flush-8:019:53:525
585266993230,2cyclictest993969-21kworker/u16:2+events_unbound18:47:156
585266993230,2cyclictest1114441-21kworker/u16:3+events_unbound20:15:416
585260993230,2cyclictest1114441-21kworker/u16:3+flush-8:019:49:284
585260993230,2cyclictest1013444-21kworker/u16:3+flush-8:019:11:144
585266993129,2cyclictest932732-21kworker/u16:0+events_unbound18:31:416
585266993129,2cyclictest832218-21kworker/u16:3+flush-8:018:01:366
585266993129,2cyclictest1154788-21kworker/u16:0+flush-8:020:37:056
585266993129,2cyclictest1114441-21kworker/u16:3+events_unbound19:57:426
585266993128,2cyclictest1033867-21kworker/u16:0+flush-8:019:14:006
585260993128,2cyclictest667510-21kworker/u16:4+flush-8:016:08:504
585260993128,2cyclictest584119-21kworker/u16:0+events_unbound15:33:334
585270993025,4cyclictest589235-21systemd-journal17:02:127
585266993028,2cyclictest821765-21kworker/u16:2+flush-8:017:58:306
585266993028,2cyclictest594956-21kworker/u16:3+flush-8:016:03:146
585266993028,2cyclictest594956-21kworker/u16:3+events_unbound15:57:416
585260993028,2cyclictest832218-21kworker/u16:3+flush-8:017:35:134
585270992924,4cyclictest589235-21systemd-journal17:23:327
585266992928,1cyclictest1084177-21kworker/u16:1+events_unbound19:27:156
585266992927,2cyclictest821765-21kworker/u16:2+flush-8:017:34:146
585266992927,2cyclictest667510-21kworker/u16:4+flush-8:017:00:146
585266992927,2cyclictest594956-21kworker/u16:3+events_unbound16:04:416
585266992927,2cyclictest1154788-21kworker/u16:0+flush-8:020:31:416
585266992927,2cyclictest1104292-21kworker/u16:2+events_unbound19:41:156
585266992927,2cyclictest1104292-21kworker/u16:2+events_unbound19:37:136
585266992926,2cyclictest594956-21kworker/u16:3+flush-8:015:43:436
585266992926,2cyclictest1124677-21kworker/u16:1+events_unbound19:48:336
585261992926,2cyclictest730323-21kworker/u16:2+flush-8:016:48:525
585260992927,2cyclictest730323-21kworker/u16:2+flush-8:016:42:054
585260992927,2cyclictest1074040-21kworker/u16:0+flush-8:019:23:294
585260992927,2cyclictest1013444-21kworker/u16:3+events_unbound18:56:154
585270992823,4cyclictest589235-21systemd-journal16:23:317
585266992826,2cyclictest972984-21kworker/u16:1+events_unbound18:38:066
585266992826,2cyclictest667510-21kworker/u16:4+flush-8:016:23:296
585266992826,2cyclictest659689-21kworker/u16:0+flush-8:017:18:056
585261992826,2cyclictest594956-21kworker/u16:3+events_unbound15:43:455
585260992825,2cyclictest832218-21kworker/u16:3+events_unbound18:41:414
585270992726,0cyclictest0-21swapper/720:08:537
585266992725,2cyclictest594956-21kworker/u16:3+flush-8:015:49:176
585266992725,2cyclictest1136119-21kworker/u16:2+events_unbound20:46:406
585266992725,2cyclictest1136119-21kworker/u16:2+events_unbound20:20:056
585260992725,2cyclictest932747-21kworker/u16:4+events_unbound18:26:054
585260992725,2cyclictest1136119-21kworker/u16:2+events_unbound20:19:144
585260992724,3cyclictest700418-21kworker/u16:3+flush-8:016:28:544
585270992625,0cyclictest0-21swapper/718:23:537
585270992620,5cyclictest932757-21latency_hist18:13:317
585266992623,2cyclictest659689-21kworker/u16:0+flush-8:016:08:426
585261992623,2cyclictest594956-21kworker/u16:3+events_unbound15:58:485
585260992624,2cyclictest972984-21kworker/u16:1+events_unbound18:51:144
585260992624,2cyclictest584119-21kworker/u16:0+events_unbound15:46:154
585266992523,2cyclictest832218-21kworker/u16:3+flush-8:018:19:166
585266992523,2cyclictest667510-21kworker/u16:4+events_unbound16:41:416
585266992523,2cyclictest1136119-21kworker/u16:2+events_unbound20:43:286
585266992523,2cyclictest1114441-21kworker/u16:3+events_unbound20:04:426
585266992523,2cyclictest1063941-21kworker/u16:2+events_unbound19:22:536
585261992522,2cyclictest871947-21kworker/u16:1+events_unbound18:13:465
585266992422,2cyclictest659689-21kworker/u16:0+flush-8:017:21:406
585266992422,2cyclictest584119-21kworker/u16:0+flush-8:015:32:176
585266992422,2cyclictest1084393-21kworker/u16:4+flush-8:019:32:446
585266992421,2cyclictest690033-21kworker/u16:1+events_unbound16:28:326
585260992422,2cyclictest871947-21kworker/u16:1+flush-8:017:50:574
585260992422,2cyclictest667510-21kworker/u16:4+events_unbound17:05:144
585260992422,2cyclictest1154788-21kworker/u16:0+events_unbound20:38:154
585270992322,0cyclictest0-21swapper/719:13:477
585270992320,2cyclictest1088235-21kthreadcore19:28:527
58527099230,21cyclictest740795-21latency_hist16:38:317
585266992320,2cyclictest821765-21kworker/u16:2+flush-8:017:28:336
585260992321,2cyclictest771056-21kworker/u16:5+events_unbound17:19:214
585260992321,2cyclictest1136119-21kworker/u16:2+flush-8:020:38:574
585270992221,0cyclictest0-21swapper/717:30:477
585266992220,2cyclictest932732-21kworker/u16:0+events_unbound18:40:256
585266992220,2cyclictest1013444-21kworker/u16:3+flush-8:019:08:466
585261992220,2cyclictest871947-21kworker/u16:1+flush-8:018:19:025
585261992220,2cyclictest554576-21kworker/u16:1+events_unbound15:34:025
585261992219,2cyclictest690033-21kworker/u16:1+flush-8:016:13:325
585261992219,2cyclictest1124677-21kworker/u16:1+flush-8:019:58:515
585260992220,2cyclictest932732-21kworker/u16:0+flush-8:018:47:214
585260992220,2cyclictest821765-21kworker/u16:2+flush-8:018:00:044
585260992220,2cyclictest1235582-21kworker/u16:1+events_unbound20:50:054
585260992219,2cyclictest771056-21kworker/u16:5+events_unbound17:08:404
585260992218,3cyclictest594956-21kworker/u16:3+flush-8:015:25:134
585270992120,0cyclictest0-21swapper/720:03:547
585266992119,2cyclictest1013444-21kworker/u16:3+events_unbound18:52:166
585261992119,2cyclictest690033-21kworker/u16:1+events_unbound16:19:015
585261992119,2cyclictest659689-21kworker/u16:0+flush-8:017:18:565
585261992119,2cyclictest1154788-21kworker/u16:0+flush-8:020:43:565
585261992119,2cyclictest1104292-21kworker/u16:2+events_unbound19:43:445
585260992120,1cyclictest932747-21kworker/u16:4+flush-8:018:30:074
585260992119,2cyclictest690033-21kworker/u16:1+events_unbound16:51:144
585260992119,2cyclictest667510-21kworker/u16:4+events_unbound16:45:424
585260992119,2cyclictest667510-21kworker/u16:4+events_unbound16:14:144
585260992119,2cyclictest659689-21kworker/u16:0+flush-8:017:15:134
585260992119,2cyclictest594956-21kworker/u16:3+events_unbound15:39:424
58527099200,18cyclictest589235-21systemd-journal20:23:317
585266992018,2cyclictest821765-21kworker/u16:2+flush-8:017:48:406
585261992018,2cyclictest832218-21kworker/u16:3+events_unbound18:38:555
585261992018,2cyclictest1084177-21kworker/u16:1+events_unbound19:33:545
585260992018,2cyclictest659689-21kworker/u16:0+events_unbound16:04:024
585270991918,0cyclictest0-21swapper/719:43:527
585270991918,0cyclictest0-21swapper/719:38:517
585270991913,5cyclictest1044091-21latency_hist19:08:317
58527099190,17cyclictest949671-21grep18:18:537
585266991917,2cyclictest972984-21kworker/u16:1+flush-8:018:58:586
585266991917,2cyclictest821765-21kworker/u16:2+events_unbound17:26:156
585266991917,2cyclictest1154788-21kworker/u16:0+events_unbound20:25:146
585266991915,3cyclictest1247088-21cat20:48:486
585261991917,2cyclictest667510-21kworker/u16:4+events_unbound16:53:585
585261991917,2cyclictest1154788-21kworker/u16:0+flush-8:020:48:565
585261991916,2cyclictest1084393-21kworker/u16:4+flush-8:019:28:495
585260991917,2cyclictest1136119-21kworker/u16:2+events_unbound20:06:054
585260991917,2cyclictest1114441-21kworker/u16:3+events_unbound19:55:414
585260991916,2cyclictest972984-21kworker/u16:1+flush-8:019:14:444
585270991817,0cyclictest0-21swapper/719:48:467
585270991816,1cyclictest0-21swapper/718:43:587
585270991816,1cyclictest0-21swapper/717:13:577
585270991813,4cyclictest720525-21latency_hist16:28:317
58527099180,17cyclictest589235-21systemd-journal20:17:137
585261991816,2cyclictest932732-21kworker/u16:0+events_unbound18:48:315
585261991816,2cyclictest832218-21kworker/u16:3+flush-8:017:24:025
585261991816,2cyclictest771056-21kworker/u16:5+events_unbound17:08:455
585261991815,3cyclictest832218-21kworker/u16:3+flush-8:017:59:005
585260991816,2cyclictest972984-21kworker/u16:1+events_unbound19:00:424
585260991816,2cyclictest1124677-21kworker/u16:1+events_unbound19:46:574
585260991816,2cyclictest1114441-21kworker/u16:3+flush-8:020:13:554
585260991815,2cyclictest1154788-21kworker/u16:0+flush-8:020:28:334
585270991716,0cyclictest0-21swapper/717:19:057
585270991716,0cyclictest0-21swapper/715:29:017
585270991715,1cyclictest0-21swapper/716:28:447
585270991715,1cyclictest0-21swapper/715:40:447
585261991715,2cyclictest584119-21kworker/u16:0+events_unbound15:38:485
585261991713,3cyclictest871947-21kworker/u16:1+flush-8:017:55:195
585260991715,2cyclictest659689-21kworker/u16:0+flush-8:016:58:484
585270991614,1cyclictest0-21swapper/715:48:477
585270991611,3cyclictest892355-21idleruntime-cro17:53:307
58527099160,14cyclictest938865-21kthreadcore18:13:527
585261991614,2cyclictest993969-21kworker/u16:2+flush-8:018:58:565
585261991614,2cyclictest972984-21kworker/u16:1+events_unbound19:19:015
585261991614,2cyclictest932732-21kworker/u16:0+flush-8:018:24:145
585261991614,2cyclictest932732-21kworker/u16:0+events_unbound18:48:475
585261991612,3cyclictest690033-21kworker/u16:1+flush-8:016:38:585
585260991614,2cyclictest667510-21kworker/u16:4+flush-8:016:53:574
585260991614,2cyclictest1136119-21kworker/u16:2+flush-8:020:12:204
585260991613,2cyclictest821765-21kworker/u16:2+flush-8:017:29:004
585270991514,0cyclictest0-21swapper/719:34:007
585270991514,0cyclictest0-21swapper/717:53:517
58527099150,14cyclictest4175659-21snmpd19:25:067
585261991513,2cyclictest659689-21kworker/u16:0+events_unbound16:04:045
585261991513,2cyclictest1154788-21kworker/u16:0+flush-8:020:08:475
585261991513,2cyclictest1013444-21kworker/u16:3+events_unbound19:08:555
585260991513,2cyclictest932747-21kworker/u16:4+events_unbound18:13:484
585260991513,2cyclictest1104292-21kworker/u16:2+events_unbound19:39:284
58527099149,4cyclictest922655-21latency_hist18:08:317
58527099149,4cyclictest862082-21latency_hist17:38:317
58527099149,4cyclictest589235-21systemd-journal20:47:137
58527099147,6cyclictest0-21swapper/720:52:137
585270991413,0cyclictest0-21swapper/717:08:477
585270991413,0cyclictest0-21swapper/716:53:477
585270991412,1cyclictest0-21swapper/716:38:577
58527099140,1cyclictest0-21swapper/715:23:567
585261991413,1cyclictest0-21swapper/519:39:005
585261991412,2cyclictest871947-21kworker/u16:1+events_unbound18:03:485
585261991412,2cyclictest659689-21kworker/u16:0+flush-8:017:15:095
585260991412,2cyclictest871947-21kworker/u16:1+flush-8:018:03:564
585260991412,2cyclictest832218-21kworker/u16:3+flush-8:017:53:574
585260991412,2cyclictest457492-21kworker/u16:2+events_unbound15:53:294
58527099138,4cyclictest589235-21systemd-journal20:31:137
58526199139,3cyclictest972969-21PK-Backend18:30:045
58526199139,3cyclictest554576-21kworker/u16:1+flush-8:015:28:445
585261991311,2cyclictest832218-21kworker/u16:3+events_unbound17:48:575
585261991311,2cyclictest667510-21kworker/u16:4+flush-8:016:43:575
585261991311,2cyclictest594956-21kworker/u16:3+flush-8:015:48:585
585261991310,3cyclictest771056-21kworker/u16:5+flush-8:017:38:555
58527099129,2cyclictest4175659-21snmpd20:39:057
58527099129,2cyclictest4175659-21snmpd19:57:287
58527099129,2cyclictest4175659-21snmpd18:52:087
58527099129,2cyclictest4175659-21snmpd17:45:077
58527099128,3cyclictest681304-21cat16:08:487
58527099128,3cyclictest4175659-21snmpd18:59:297
58527099126,5cyclictest3798303-21gmain15:33:527
58527099125,6cyclictest0-21swapper/717:06:277
58527099125,6cyclictest0-21swapper/716:18:047
58527099124,7cyclictest27763-21gvfs-afc-volume16:48:587
585270991210,1cyclictest0-21swapper/719:19:267
585261991211,1cyclictest0-21swapper/519:16:185
585261991210,2cyclictest667510-21kworker/u16:4+flush-8:016:13:575
58526199120,12cyclictest0-21swapper/517:33:305
585260991210,2cyclictest1154788-21kworker/u16:0+events_unbound20:43:554
585260991210,2cyclictest1154788-21kworker/u16:0+events_unbound20:01:334
58527099117,4cyclictest27763-21gvfs-afc-volume19:58:537
58527099116,4cyclictest589235-21systemd-journal17:42:127
58527099110,2cyclictest1020552-21grep18:53:527
58527099110,10cyclictest4175659-21snmpd20:34:087
58526199119,2cyclictest667510-21kworker/u16:4+events_unbound17:03:565
58526199118,2cyclictest3366955-21kworker/u16:5+flush-8:015:24:015
585261991110,1cyclictest0-21swapper/520:13:595
585261991110,1cyclictest0-21swapper/518:35:095
58526199110,11cyclictest0-21swapper/520:39:415
58526199110,11cyclictest0-21swapper/518:09:185
58526199110,11cyclictest0-21swapper/517:48:205
58526099119,2cyclictest659689-21kworker/u16:0+events_unbound15:55:584
58527099108,1cyclictest0-21swapper/720:20:407
58527099106,3cyclictest948-21NetworkManager15:47:527
58526199109,1cyclictest0-21swapper/519:27:485
5852619998,1cyclictest0-21swapper/516:35:015
5852619998,1cyclictest0-21swapper/516:33:275
5852619996,2cyclictest0-21swapper/520:18:495
5852619987,1cyclictest0-21swapper/520:35:545
5852619987,1cyclictest0-21swapper/519:52:055
5852619986,1cyclictest0-21swapper/515:53:505
5852619985,2cyclictest1033867-21kworker/u16:0+flush-8:019:03:445
5852619984,3cyclictest856959-21kthreadcore17:33:505
5852619975,1cyclictest0-21swapper/516:58:485
5852619974,2cyclictest1155544-21cpu20:03:445
5852619972,4cyclictest1206747-21grep20:28:465
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional