You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-03 - 07:41
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Wed Dec 03, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
225901226857,7sleep40-21swapper/403:19:354
225924926336,8sleep50-21swapper/503:22:495
225922025329,8sleep60-21swapper/603:22:266
2259617995047,2cyclictest2857925-21kworker/u16:3+flush-8:008:22:495
2259617995047,2cyclictest2283241-21kworker/u16:2+flush-8:003:37:495
2259617994947,2cyclictest2757165-21kworker/u16:1+events_unbound07:43:125
225962499470,45cyclictest1021-21rs:main7
2259624994641,4cyclictest2269547-21latency_hist03:27:497
2259617994642,3cyclictest2384215-21kworker/u16:1+flush-8:004:47:495
225901524511,30sleep70-21swapper/703:19:387
2259624994337,5cyclictest976-21in:imjournal08:12:497
2259617993836,2cyclictest2485049-21kworker/u16:4+flush-8:005:22:495
2259621993735,2cyclictest2837898-21kworker/u16:1+flush-8:008:42:126
2259624993631,4cyclictest2394326-21latency_hist04:27:497
2259612993634,2cyclictest2544700-21kworker/u16:1+flush-8:005:58:054
2259621993533,2cyclictest2293384-21kworker/u16:4+flush-8:004:39:116
2259624993429,4cyclictest589235-21systemd-journal08:47:487
2259624993429,4cyclictest2757272-21latency_hist07:27:497
2259621993432,2cyclictest2908408-21kworker/u16:0+flush-8:008:44:286
2259621993432,2cyclictest2596146-21kworker/u16:1+events_unbound06:45:136
2259621993432,2cyclictest2596146-21kworker/u16:1+events_unbound06:45:136
2259612993430,3cyclictest2384215-21kworker/u16:1+flush-8:005:03:204
2259621993331,2cyclictest2837898-21kworker/u16:1+events_unbound08:16:526
2259621993331,2cyclictest2837898-21kworker/u16:1+events_unbound08:16:526
2259621993331,2cyclictest2817440-21kworker/u16:0+events_unbound08:23:136
2259621993331,2cyclictest2439174-21kworker/u16:2+events_unbound05:44:056
2259621993331,2cyclictest2439174-21kworker/u16:2+events_unbound05:11:506
2259621993331,2cyclictest2439174-21kworker/u16:2+events_unbound04:56:496
2259621993330,2cyclictest2293384-21kworker/u16:4+flush-8:004:42:576
2259617993330,2cyclictest2439174-21kworker/u16:2+events_unbound05:33:045
2259621993230,2cyclictest2596146-21kworker/u16:1+events_unbound06:40:496
2259621993230,2cyclictest2544700-21kworker/u16:1+events_unbound06:00:406
2259621993230,2cyclictest2485049-21kworker/u16:4+events_unbound05:32:006
2259617993230,2cyclictest2827775-21kworker/u16:2+events_unbound08:03:125
2259617993230,2cyclictest2596146-21kworker/u16:1+flush-8:006:28:135
2259617993230,2cyclictest2183596-21kworker/u16:1+flush-8:003:28:185
2259621993129,2cyclictest2334319-21kworker/u16:0+events_unbound04:14:136
2259621993129,2cyclictest2283241-21kworker/u16:2+flush-8:003:34:106
2259621993129,2cyclictest2283241-21kworker/u16:2+events_unbound04:04:506
2259621993128,2cyclictest2596146-21kworker/u16:1+events_unbound06:52:506
2259617993127,3cyclictest2596146-21kworker/u16:1+events_unbound07:03:045
2259624993025,4cyclictest2908517-21latency_hist08:42:497
2259621993028,2cyclictest2827775-21kworker/u16:2+flush-8:008:11:126
2259621993028,2cyclictest2787656-21kworker/u16:4+events_unbound08:36:016
2259621993028,2cyclictest2726791-21kworker/u16:3+flush-8:007:14:166
2259621993028,2cyclictest2726791-21kworker/u16:3+flush-8:007:10:126
2259621993028,2cyclictest2596346-21kworker/u16:4+events_unbound06:29:006
2259621993028,2cyclictest2485049-21kworker/u16:4+flush-8:005:21:506
2259621993028,2cyclictest2485049-21kworker/u16:4+events_unbound05:54:096
2259621993028,2cyclictest2183596-21kworker/u16:1+flush-8:003:28:136
2259621993027,3cyclictest2596146-21kworker/u16:1+flush-8:007:01:526
2259621993026,3cyclictest2656318-21kworker/u16:2+flush-8:006:50:526
2259617993028,2cyclictest2439174-21kworker/u16:2+flush-8:005:48:125
2259612993027,2cyclictest2908408-21kworker/u16:0+flush-8:008:43:124
2259624992924,4cyclictest2837897-21latency_hist08:07:497
2259621992927,2cyclictest2817440-21kworker/u16:0+flush-8:008:06:006
2259621992927,2cyclictest2817440-21kworker/u16:0+events_unbound08:20:046
2259621992927,2cyclictest2736881-21kworker/u16:2+flush-8:007:23:166
2259621992927,2cyclictest2596146-21kworker/u16:1+flush-8:006:09:166
2259621992927,2cyclictest2439174-21kworker/u16:2+events_unbound05:25:096
2259621992927,2cyclictest2293384-21kworker/u16:4+flush-8:004:49:056
2259621992926,2cyclictest2439174-21kworker/u16:2+events_unbound05:02:496
2259621992926,2cyclictest2293384-21kworker/u16:4+events_unbound03:42:046
2259612992927,2cyclictest2228985-21kworker/u16:0+flush-8:003:43:054
2259621992826,2cyclictest2757165-21kworker/u16:1+events_unbound07:59:566
2259621992826,2cyclictest2485049-21kworker/u16:4+flush-8:005:36:416
2259621992826,2cyclictest2439174-21kworker/u16:2+events_unbound05:51:566
2259621992826,2cyclictest2384215-21kworker/u16:1+flush-8:004:58:226
2259621992826,2cyclictest2334319-21kworker/u16:0+flush-8:004:19:206
2259621992826,2cyclictest2259799-21kworker/u16:4+flush-8:003:24:046
2259621992825,2cyclictest2585862-21kworker/u16:3+flush-8:006:02:556
2259617992825,3cyclictest2596346-21kworker/u16:4+events_unbound06:33:065
2259617992825,3cyclictest2293384-21kworker/u16:4+flush-8:004:38:045
2259621992725,2cyclictest2726791-21kworker/u16:3+flush-8:007:32:046
2259621992725,2cyclictest2726791-21kworker/u16:3+flush-8:007:32:046
2259621992725,2cyclictest2596146-21kworker/u16:1+flush-8:006:36:246
2259621992725,2cyclictest2575592-21kworker/u16:0+events_unbound06:14:076
2259621992725,2cyclictest2439174-21kworker/u16:2+events_unbound05:16:496
2259621992725,2cyclictest2293384-21kworker/u16:4+flush-8:004:29:526
2259621992724,2cyclictest2837898-21kworker/u16:1+flush-8:008:27:526
2259617992725,2cyclictest2837898-21kworker/u16:1+events_unbound08:28:035
2259624992621,4cyclictest589235-21systemd-journal08:13:497
2259624992621,4cyclictest589235-21systemd-journal08:13:497
2259621992624,2cyclictest2485049-21kworker/u16:4+events_unbound05:39:596
2259621992624,2cyclictest2439174-21kworker/u16:2+events_unbound06:26:456
2259621992624,2cyclictest2303701-21kworker/u16:1+events_unbound03:54:256
2259621992624,2cyclictest2283241-21kworker/u16:2+events_unbound03:51:526
2259617992624,2cyclictest2183596-21kworker/u16:1+flush-8:003:23:035
2259624992519,5cyclictest2313739-21latency_hist03:47:507
225962499250,1cyclictest0-21swapper/707:53:137
2259621992523,2cyclictest2757165-21kworker/u16:1+flush-8:007:47:046
2259621992523,2cyclictest2757165-21kworker/u16:1+flush-8:007:38:326
2259621992523,2cyclictest2736881-21kworker/u16:2+flush-8:007:21:076
2259617992523,2cyclictest2787656-21kworker/u16:4+flush-8:008:38:175
2259617992523,2cyclictest2544700-21kworker/u16:1+flush-8:005:58:025
2259617992521,3cyclictest2736881-21kworker/u16:2+flush-8:007:28:045
2259617992521,3cyclictest2736881-21kworker/u16:2+flush-8:007:28:045
2259612992521,3cyclictest2334319-21kworker/u16:0+flush-8:004:28:084
2259621992422,2cyclictest2787656-21kworker/u16:4+events_unbound07:50:516
2259621992422,2cyclictest2736881-21kworker/u16:2+flush-8:007:37:206
2259621992422,2cyclictest2404069-21kworker/u16:3+flush-8:004:36:486
2259617992422,2cyclictest2575592-21kworker/u16:0+flush-8:006:13:205
2259612992422,2cyclictest2596146-21kworker/u16:1+events_unbound06:18:034
2259624992317,5cyclictest589235-21systemd-journal03:27:497
2259621992321,2cyclictest2439174-21kworker/u16:2+events_unbound06:21:586
2259621992321,2cyclictest2384215-21kworker/u16:1+events_unbound04:26:166
2259621992321,2cyclictest2293384-21kworker/u16:4+flush-8:004:09:366
2259621992321,2cyclictest2228985-21kworker/u16:0+events_unbound03:43:506
2259617992321,2cyclictest2787656-21kworker/u16:4+flush-8:007:53:035
2259617992321,2cyclictest2736881-21kworker/u16:2+flush-8:007:36:555
2259621992220,2cyclictest2908408-21kworker/u16:0+flush-8:008:47:596
2259621992220,2cyclictest2787656-21kworker/u16:4+flush-8:007:55:066
2259621992220,2cyclictest2676621-21kworker/u16:0+flush-8:007:05:146
2259617992220,2cyclictest2439174-21kworker/u16:2+flush-8:004:48:145
2259617992220,2cyclictest2439174-21kworker/u16:2+events_unbound05:43:045
2259624992115,5cyclictest2595953-21latency_hist06:07:497
2259621992119,2cyclictest2293384-21kworker/u16:4+events_unbound03:58:416
2259617992119,2cyclictest2596146-21kworker/u16:1+flush-8:006:43:145
2259617992119,2cyclictest2596146-21kworker/u16:1+flush-8:006:43:145
2259617992119,2cyclictest2439174-21kworker/u16:2+flush-8:005:28:035
2259617992119,2cyclictest2384215-21kworker/u16:1+flush-8:004:28:285
2259617992119,2cyclictest2384215-21kworker/u16:1+events_unbound04:23:205
2259612992119,2cyclictest2575592-21kworker/u16:0+flush-8:006:03:064
2259612992113,2cyclictest2868042-21chrt08:21:184
2259617992018,2cyclictest2293384-21kworker/u16:4+flush-8:003:43:115
225961299200,4cyclictest2748280-21cut07:23:044
2259624991915,3cyclictest4175659-21snmpd06:24:257
2259624991915,3cyclictest4175659-21snmpd05:16:217
2259617991917,2cyclictest2464851-21kworker/u16:3+events_unbound05:03:125
2259617991917,2cyclictest2439174-21kworker/u16:2+events_unbound06:08:135
2259617991917,2cyclictest2283241-21kworker/u16:2+flush-8:003:48:195
2259617991917,2cyclictest2283241-21kworker/u16:2+flush-8:003:38:145
2259624991813,4cyclictest589235-21systemd-journal07:15:127
2259624991812,5cyclictest589235-21systemd-journal06:57:497
2259617991816,2cyclictest2736881-21kworker/u16:2+flush-8:007:23:155
2259617991816,2cyclictest2303701-21kworker/u16:1+flush-8:003:56:425
2259617991815,3cyclictest2596146-21kworker/u16:1+flush-8:007:08:155
2259617991814,3cyclictest2837898-21kworker/u16:1+flush-8:008:33:145
2259624991714,2cyclictest4175659-21snmpd06:34:527
2259624991711,5cyclictest2807627-21latency_hist07:52:497
225962499170,16cyclictest2464812-21latency_hist05:02:497
225962499170,15cyclictest2454737-21latency_hist04:57:507
2259617991714,2cyclictest2293384-21kworker/u16:4+events_unbound04:18:045
225961299170,1cyclictest0-21swapper/408:39:354
225961299170,1cyclictest0-21swapper/408:33:274
225961299170,1cyclictest0-21swapper/408:29:214
225961299170,1cyclictest0-21swapper/408:23:204
225961299170,1cyclictest0-21swapper/408:10:064
225961299170,1cyclictest0-21swapper/407:59:524
225961299170,1cyclictest0-21swapper/407:53:434
225961299170,1cyclictest0-21swapper/407:51:404
225961299170,1cyclictest0-21swapper/407:45:314
225961299170,1cyclictest0-21swapper/407:40:244
225961299170,1cyclictest0-21swapper/407:33:184
225961299170,1cyclictest0-21swapper/407:17:574
225961299170,1cyclictest0-21swapper/407:13:514
225961299170,1cyclictest0-21swapper/407:05:394
225961299170,1cyclictest0-21swapper/406:59:314
225961299170,1cyclictest0-21swapper/406:53:224
225961299170,1cyclictest0-21swapper/406:40:044
225961299170,1cyclictest0-21swapper/406:32:534
225961299170,1cyclictest0-21swapper/406:28:484
225961299170,1cyclictest0-21swapper/406:24:424
225961299170,1cyclictest0-21swapper/406:13:264
225961299170,1cyclictest0-21swapper/406:12:254
225961299170,1cyclictest0-21swapper/405:53:594
225961299170,1cyclictest0-21swapper/405:47:504
225961299170,1cyclictest0-21swapper/405:43:444
225961299170,1cyclictest0-21swapper/405:41:424
225961299170,1cyclictest0-21swapper/405:35:334
225961299170,1cyclictest0-21swapper/405:31:274
225961299170,1cyclictest0-21swapper/405:25:234
225961299170,1cyclictest0-21swapper/405:18:134
225961299170,1cyclictest0-21swapper/405:13:054
225961299170,1cyclictest0-21swapper/405:10:014
225961299170,1cyclictest0-21swapper/404:59:474
225961299170,1cyclictest0-21swapper/404:53:384
225961299170,1cyclictest0-21swapper/404:45:274
225961299170,1cyclictest0-21swapper/404:40:244
225961299170,1cyclictest0-21swapper/404:26:034
225961299170,1cyclictest0-21swapper/404:18:534
225961299170,1cyclictest0-21swapper/404:16:514
225961299170,1cyclictest0-21swapper/404:09:404
225962499167,8cyclictest4175659-21snmpd03:54:167
2259624991613,2cyclictest4175659-21snmpd05:54:397
225962499160,14cyclictest2787452-21latency_hist07:42:497
2259617991614,2cyclictest2676621-21kworker/u16:0+flush-8:007:18:155
225961299160,1cyclictest0-21swapper/408:49:504
225961299160,1cyclictest0-21swapper/408:16:154
225961299160,1cyclictest0-21swapper/408:16:154
225961299160,1cyclictest0-21swapper/408:03:574
225961299160,1cyclictest0-21swapper/407:28:114
225961299160,1cyclictest0-21swapper/407:28:114
225961299160,1cyclictest0-21swapper/407:09:454
225961299160,1cyclictest0-21swapper/406:48:154
225961299160,1cyclictest0-21swapper/406:43:084
225961299160,1cyclictest0-21swapper/406:43:084
225961299160,1cyclictest0-21swapper/404:49:324
225961299160,1cyclictest0-21swapper/404:33:144
225962499155,9cyclictest4175659-21snmpd06:30:347
2259624991513,1cyclictest0-21swapper/704:43:097
2259624991511,3cyclictest4175659-21snmpd08:49:417
225962499150,14cyclictest4175659-21snmpd05:21:577
2259617991513,2cyclictest2334319-21kworker/u16:0+flush-8:004:13:185
2259617991512,2cyclictest2439174-21kworker/u16:2+flush-8:006:23:075
2259617991512,2cyclictest2334319-21kworker/u16:0+flush-8:004:06:415
2259617991511,3cyclictest2293384-21kworker/u16:4+flush-8:004:33:155
2259624991413,0cyclictest0-21swapper/708:00:177
2259624991412,1cyclictest2293589-21awk03:37:497
225962499140,1cyclictest0-21swapper/703:38:157
2259617991412,2cyclictest2817440-21kworker/u16:0+flush-8:008:13:155
2259617991412,2cyclictest2817440-21kworker/u16:0+flush-8:008:13:155
2259617991412,2cyclictest2757165-21kworker/u16:1+events_unbound07:48:115
2259617991412,2cyclictest2439174-21kworker/u16:2+flush-8:005:08:125
2259617991411,3cyclictest2596146-21kworker/u16:1+flush-8:007:13:055
2259617991410,3cyclictest2596146-21kworker/u16:1+flush-8:006:38:065
225961299140,14cyclictest0-21swapper/403:53:164
225962499139,3cyclictest2676745-21cut06:47:497
225962499139,3cyclictest2676745-21cut06:47:497
225962499138,4cyclictest589235-21systemd-journal04:48:107
225962499138,4cyclictest2706913-21latency_hist07:02:497
225962499133,8cyclictest0-21swapper/704:17:497
225962499132,10cyclictest4175659-21snmpd04:34:237
2259617991311,2cyclictest2857925-21kworker/u16:3+flush-8:008:52:485
225961799130,1cyclictest0-21swapper/508:44:125
225962499129,2cyclictest4175659-21snmpd05:35:247
225962499129,2cyclictest4175659-21snmpd04:39:087
225962499129,2cyclictest4175659-21snmpd04:30:447
225962499129,2cyclictest4175659-21snmpd04:08:317
225962499129,2cyclictest0-21swapper/706:12:497
225962499128,3cyclictest4175659-21snmpd05:43:157
225962499128,3cyclictest4175659-21snmpd05:07:027
225962499128,3cyclictest27394-21gmain07:43:077
225962499127,4cyclictest2767185-21sshd-session07:30:557
225962499127,4cyclictest2767185-21sshd-session07:30:557
225962499124,7cyclictest4175659-21snmpd07:06:597
225962499124,7cyclictest0-21swapper/706:38:127
225962499121,9cyclictest4175659-21snmpd08:18:087
2259624991211,0cyclictest0-21swapper/707:22:457
2259624991210,1cyclictest0-21swapper/706:13:177
2259624991210,1cyclictest0-21swapper/705:28:097
225962499120,2cyclictest0-21swapper/706:48:157
225962499120,10cyclictest0-21swapper/707:33:127
2259617991211,1cyclictest0-21swapper/506:58:165
2259617991211,1cyclictest0-21swapper/506:04:595
225961799120,1cyclictest0-21swapper/505:23:415
225961799120,12cyclictest0-21swapper/507:39:065
225961799120,0cyclictest0-21swapper/503:58:245
225962499119,1cyclictest0-21swapper/706:18:037
225962499119,1cyclictest0-21swapper/705:23:137
225962499118,2cyclictest4175659-21snmpd05:40:067
225962499118,2cyclictest2868551-21/usr/sbin/munin08:23:157
225962499118,2cyclictest2557292-21cut05:48:067
225962499118,2cyclictest0-21swapper/708:33:027
225962499117,3cyclictest27177-21gmain03:48:047
225962499116,0cyclictest0-21swapper/703:58:107
225962499111,1cyclictest0-21swapper/708:28:107
225962499110,9cyclictest984960-21gvfsd-wsdd04:03:077
225962499110,10cyclictest4175659-21snmpd05:12:147
225961799119,2cyclictest2439174-21kworker/u16:2+events_unbound06:18:115
225961799118,2cyclictest2575592-21kworker/u16:0+flush-8:005:55:435
225961799116,4cyclictest2687894-21cat06:53:055
2259617991110,1cyclictest0-21swapper/508:09:415
2259617991110,1cyclictest0-21swapper/508:01:015
2259617991110,1cyclictest0-21swapper/505:15:485
2259617991110,1cyclictest0-21swapper/504:53:535
225961799110,11cyclictest0-21swapper/505:39:365
225961299110,11cyclictest0-21swapper/403:59:444
225961299110,11cyclictest0-21swapper/403:35:274
225962499109,0cyclictest0-21swapper/704:12:567
225962499104,1cyclictest0-21swapper/705:58:087
225961799109,1cyclictest0-21swapper/504:10:515
225961299109,1cyclictest0-21swapper/404:03:504
225961299109,1cyclictest0-21swapper/403:29:004
225961299109,1cyclictest0-21swapper/403:24:544
22596179998,1cyclictest0-21swapper/505:01:275
22596179997,2cyclictest2656318-21kworker/u16:2+flush-8:006:48:145
22596179990,8cyclictest0-21swapper/508:23:035
22596129983,4cyclictest2323287-21timerwakeupswit03:48:204
22596129983,4cyclictest2294408-21cat03:38:034
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional