You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-16 - 20:52
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Sun Nov 16, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1943422996660,5cyclictest4184977-17auditd16:58:547
194301725722,30sleep70-21swapper/715:23:237
194297725545,7sleep50-21swapper/515:22:485
194274425544,7sleep40-21swapper/415:19:344
194303025039,7sleep60-21swapper/615:23:306
1943422994643,1cyclictest0-21swapper/719:48:557
1943417994644,2cyclictest2189760-21kworker/u16:2+events_unbound17:24:225
1943412994644,2cyclictest2320592-21kworker/u16:2+flush-8:018:29:274
1943412994644,2cyclictest2229343-21kworker/u16:2+flush-8:017:43:544
1943422993934,4cyclictest2048429-21latency_hist16:13:557
1943417993937,2cyclictest2028324-21kworker/u16:2+events_unbound16:27:575
1943417993836,2cyclictest2341408-21kworker/u16:1+events_unbound19:11:435
1943417993835,2cyclictest1953772-21kworker/u16:1+events_unbound15:49:135
1943417993735,2cyclictest2453018-21kworker/u16:3+events_unbound19:53:425
1943417993634,2cyclictest2513056-21kworker/u16:2+events_unbound20:30:425
1943417993634,2cyclictest2229343-21kworker/u16:2+flush-8:017:44:245
1943422993534,0cyclictest0-21swapper/720:34:177
194342299350,33cyclictest589235-21systemd-journal19:38:557
1943417993533,2cyclictest2513056-21kworker/u16:2+events_unbound20:38:435
1943417993533,2cyclictest2513056-21kworker/u16:2+events_unbound20:07:465
1943417993533,2cyclictest2259907-21kworker/u16:5+flush-8:018:38:425
1943417993533,2cyclictest2077784-21kworker/u16:4+flush-8:017:38:485
1943417993533,2cyclictest2077784-21kworker/u16:4+events_unbound16:47:455
1943417993533,2cyclictest1953773-21kworker/u16:4+events_unbound15:40:455
1943422993432,1cyclictest0-21swapper/717:19:177
1943417993432,2cyclictest2513133-21kworker/u16:3+events_unbound20:12:185
1943417993432,2cyclictest2048816-21kworker/u16:1+flush-8:016:19:575
1943417993432,2cyclictest2028324-21kworker/u16:2+events_unbound16:55:055
1943417993432,2cyclictest1235728-21kworker/u16:0+events_unbound16:12:465
1943412993432,2cyclictest2077784-21kworker/u16:4+events_unbound16:29:214
194342299330,31cyclictest2442696-21latency_hist19:28:557
1943417993331,2cyclictest2320592-21kworker/u16:2+events_unbound19:31:435
1943417993331,2cyclictest2119541-21kworker/u16:5+flush-8:017:08:455
1943417993330,2cyclictest2533220-21kworker/u16:4+flush-8:020:13:555
1943412993331,2cyclictest2513133-21kworker/u16:3+flush-8:020:24:204
1943412993331,2cyclictest2259907-21kworker/u16:5+events_unbound18:45:064
1943412993331,2cyclictest2119541-21kworker/u16:5+events_unbound17:00:194
1943412993331,2cyclictest2077784-21kworker/u16:4+events_unbound17:58:434
1943422993231,0cyclictest0-21swapper/715:44:107
1943422993230,1cyclictest2340693-21strings18:34:197
1943417993230,2cyclictest2311266-21kworker/u16:0+events_unbound18:40:375
1943417993230,2cyclictest2119541-21kworker/u16:5+flush-8:017:11:445
1943412993230,2cyclictest2513133-21kworker/u16:3+flush-8:020:13:454
1943412993229,2cyclictest2007928-21kworker/u16:3+flush-8:015:53:564
1943422993130,0cyclictest0-21swapper/720:14:257
1943417993129,2cyclictest2513133-21kworker/u16:3+flush-8:020:43:075
1943417993129,2cyclictest2108855-21kworker/u16:3+flush-8:016:42:065
1943417993128,2cyclictest2259907-21kworker/u16:5+flush-8:018:08:565
1943412993129,2cyclictest2513133-21kworker/u16:3+events_unbound20:15:574
1943412993129,2cyclictest2341408-21kworker/u16:1+flush-8:019:09:054
1943412993129,2cyclictest2341408-21kworker/u16:1+events_unbound19:20:254
1943412993129,2cyclictest2028325-21kworker/u16:5+events_unbound16:06:584
1943412993129,2cyclictest1235728-21kworker/u16:0+events_unbound15:36:434
1943412993128,2cyclictest2259907-21kworker/u16:5+events_unbound19:13:584
1943412993128,2cyclictest2149253-21kworker/u16:0+events_unbound17:06:504
1943417993028,2cyclictest2603990-21kworker/u16:4+events_unbound20:48:065
1943417993028,2cyclictest2513133-21kworker/u16:3+events_unbound20:03:385
1943417993028,2cyclictest2393806-21kworker/u16:0+events_unbound19:55:145
1943417993028,2cyclictest2341408-21kworker/u16:1+events_unbound19:02:445
1943417993028,2cyclictest2341408-21kworker/u16:1+events_unbound18:58:185
1943417993028,2cyclictest2320592-21kworker/u16:2+flush-8:019:37:455
1943417993028,2cyclictest2320592-21kworker/u16:2+events_unbound18:31:065
1943417993028,2cyclictest2259907-21kworker/u16:5+flush-8:019:23:585
1943417993028,2cyclictest2259907-21kworker/u16:5+events_unbound19:15:575
1943417993028,2cyclictest1953772-21kworker/u16:1+events_unbound15:38:265
1943412993028,2cyclictest2583990-21kworker/u16:0+events_unbound20:52:374
1943412993028,2cyclictest2229343-21kworker/u16:2+events_unbound18:14:574
1943422992928,0cyclictest0-21swapper/719:04:167
1943422992928,0cyclictest0-21swapper/716:34:147
1943417992927,2cyclictest2259907-21kworker/u16:5+events_unbound18:21:225
1943417992927,2cyclictest2229343-21kworker/u16:2+flush-8:018:06:585
1943417992927,2cyclictest2149253-21kworker/u16:0+events_unbound17:22:305
1943417992927,2cyclictest1953773-21kworker/u16:4+events_unbound15:44:305
1943417992926,2cyclictest2341408-21kworker/u16:1+events_unbound19:03:565
1943417992926,2cyclictest2159561-21kworker/u16:1+flush-8:017:28:585
1943412992927,2cyclictest2513056-21kworker/u16:2+events_unbound20:21:544
1943412992927,2cyclictest2472983-21kworker/u16:1+events_unbound19:45:184
1943412992927,2cyclictest2320592-21kworker/u16:2+flush-8:018:25:444
1943412992927,2cyclictest2280968-21kworker/u16:1+events_unbound18:08:224
1943412992927,2cyclictest2259907-21kworker/u16:5+events_unbound19:35:144
1943412992927,2cyclictest2159561-21kworker/u16:1+flush-8:017:11:014
1943412992927,2cyclictest1886615-21kworker/u16:2+flush-8:015:30:444
1943412992927,2cyclictest1235728-21kworker/u16:0+flush-8:015:24:344
1943412992926,2cyclictest2311266-21kworker/u16:0+flush-8:018:34:064
1943417992826,2cyclictest2393806-21kworker/u16:0+events_unbound19:23:385
1943417992826,2cyclictest2320592-21kworker/u16:2+events_unbound19:42:305
1943417992826,2cyclictest2259907-21kworker/u16:5+flush-8:018:24:245
1943417992826,2cyclictest2229343-21kworker/u16:2+flush-8:017:52:385
1943417992826,2cyclictest2007928-21kworker/u16:3+events_unbound16:08:135
1943417992825,2cyclictest2341408-21kworker/u16:1+events_unbound18:44:025
1943417992825,2cyclictest2259907-21kworker/u16:5+events_unbound18:49:015
1943412992826,2cyclictest2513056-21kworker/u16:2+events_unbound20:01:044
1943412992826,2cyclictest2259907-21kworker/u16:5+events_unbound18:20:464
1943412992826,2cyclictest2077784-21kworker/u16:4+events_unbound18:09:304
1943412992826,2cyclictest2077784-21kworker/u16:4+events_unbound16:25:384
1943412992826,2cyclictest2028324-21kworker/u16:2+flush-8:016:39:454
1943412992826,2cyclictest1953773-21kworker/u16:4+flush-8:015:43:344
1943412992826,2cyclictest1953772-21kworker/u16:1+events_unbound15:48:094
1943412992825,2cyclictest2513133-21kworker/u16:3+flush-8:020:39:014
1943422992725,1cyclictest0-21swapper/720:19:217
1943422992722,4cyclictest2503286-21latency_hist19:58:547
1943417992725,2cyclictest2230159-21kworker/u16:3+events_unbound17:42:185
1943417992725,2cyclictest2229343-21kworker/u16:2+flush-8:018:01:095
1943417992725,2cyclictest2119541-21kworker/u16:5+events_unbound17:18:015
1943417992725,2cyclictest2077784-21kworker/u16:4+flush-8:017:02:585
1943417992725,2cyclictest2007928-21kworker/u16:3+events_unbound16:02:465
1943417992725,2cyclictest1235728-21kworker/u16:0+flush-8:015:27:135
1943417992725,2cyclictest1235728-21kworker/u16:0+events_unbound16:36:485
1943417992724,2cyclictest2259907-21kworker/u16:5+events_unbound18:14:045
1943412992725,2cyclictest2533220-21kworker/u16:4+events_unbound20:33:014
1943412992725,2cyclictest2393806-21kworker/u16:0+events_unbound19:32:514
1943412992725,2cyclictest2311266-21kworker/u16:0+flush-8:018:41:064
1943412992725,2cyclictest2259907-21kworker/u16:5+flush-8:019:04:454
1943412992725,2cyclictest2229343-21kworker/u16:2+events_unbound17:46:344
1943412992725,2cyclictest2189760-21kworker/u16:2+flush-8:017:23:534
1943412992725,2cyclictest2159561-21kworker/u16:1+events_unbound17:36:174
1943412992725,2cyclictest2077784-21kworker/u16:4+flush-8:016:52:024
1943412992725,2cyclictest1953773-21kworker/u16:4+events_unbound15:50:184
1943412992724,2cyclictest2483034-21kworker/u16:4+flush-8:019:54:054
1943422992621,4cyclictest589235-21systemd-journal15:31:437
1943422992621,4cyclictest2371981-21latency_hist18:53:557
1943417992624,2cyclictest2513133-21kworker/u16:3+events_unbound20:25:065
1943417992624,2cyclictest2513133-21kworker/u16:3+events_unbound20:23:175
1943417992624,2cyclictest2393806-21kworker/u16:0+flush-8:019:44:455
1943417992624,2cyclictest2028324-21kworker/u16:2+flush-8:016:28:565
1943417992624,2cyclictest2007928-21kworker/u16:3+events_unbound16:14:025
1943417992624,2cyclictest1886615-21kworker/u16:2+flush-8:015:30:585
1943412992624,2cyclictest2320592-21kworker/u16:2+flush-8:019:26:094
1943412992624,2cyclictest2149253-21kworker/u16:0+events_unbound17:25:344
1943412992624,2cyclictest2149253-21kworker/u16:0+events_unbound17:15:424
1943412992624,2cyclictest2048816-21kworker/u16:1+flush-8:016:34:384
1943412992623,2cyclictest2320592-21kworker/u16:2+events_unbound18:59:074
1943417992523,2cyclictest2583990-21kworker/u16:0+events_unbound20:52:575
1943417992523,2cyclictest2077784-21kworker/u16:4+events_unbound16:52:175
1943417992523,2cyclictest2007928-21kworker/u16:3+events_unbound15:58:365
1943417992522,2cyclictest2240331-21kworker/u16:0+events_unbound17:53:565
1943412992523,2cyclictest2513056-21kworker/u16:2+flush-8:020:34:494
1943412992523,2cyclictest2513056-21kworker/u16:2+events_unbound20:07:254
1943412992523,2cyclictest2320592-21kworker/u16:2+events_unbound19:41:334
1943412992523,2cyclictest2311266-21kworker/u16:0+events_unbound18:50:254
1943412992523,2cyclictest2240331-21kworker/u16:0+events_unbound17:59:544
1943412992523,2cyclictest2077784-21kworker/u16:4+events_unbound16:48:304
1943412992523,2cyclictest2007928-21kworker/u16:3+events_unbound16:16:524
1943412992523,2cyclictest2007928-21kworker/u16:3+events_unbound16:00:224
1943412992422,2cyclictest2472983-21kworker/u16:1+events_unbound19:53:094
1943412992422,2cyclictest2320592-21kworker/u16:2+flush-8:018:58:544
1943412992421,2cyclictest2513133-21kworker/u16:3+events_unbound20:43:544
1943422992322,0cyclictest0-21swapper/716:44:247
1943422992318,4cyclictest2008064-21latency_hist15:53:557
1943422992317,5cyclictest2068684-21latency_hist16:23:557
1943412992321,2cyclictest2240331-21kworker/u16:0+events_unbound17:53:314
1943412992321,2cyclictest2159561-21kworker/u16:1+flush-8:017:31:184
1943412992220,2cyclictest2077784-21kworker/u16:4+events_unbound16:58:264
1943412992220,2cyclictest2007928-21kworker/u16:3+events_unbound16:19:214
1943412992220,2cyclictest2007928-21kworker/u16:3+events_unbound16:12:014
1943422992115,5cyclictest2382081-21latency_hist18:58:557
194342299210,19cyclictest2204627-21grep17:29:147
1943422992020,0cyclictest0-21swapper/719:29:257
1943422991917,1cyclictest0-21swapper/718:59:087
1943422991816,1cyclictest0-21swapper/717:59:107
1943422991813,4cyclictest2422518-21latency_hist19:18:547
1943422991813,4cyclictest1953394-21latency_hist15:28:557
1943422991716,0cyclictest0-21swapper/719:39:157
1943422991714,2cyclictest0-21swapper/718:13:557
194342299170,16cyclictest589235-21systemd-journal16:42:437
194342299170,16cyclictest0-21swapper/717:14:227
1943419991712,3cyclictest0-21swapper/617:54:196
194342299167,8cyclictest27204-21gmain17:34:177
1943422991615,0cyclictest0-21swapper/720:04:097
1943422991615,0cyclictest0-21swapper/715:59:217
1943422991611,4cyclictest2361883-21latency_hist18:48:557
194342299160,14cyclictest0-21swapper/720:39:257
194341999160,1cyclictest0-21swapper/619:53:586
194342299159,5cyclictest2250772-21latency_hist17:53:557
194342299159,5cyclictest2200155-21latency_hist17:28:557
1943422991514,0cyclictest0-21swapper/716:59:137
194342299150,13cyclictest2604325-21turbostat20:48:547
194341999157,7cyclictest2292386-21cat18:14:126
194341999150,3cyclictest19449431kthreadcore15:24:126
194341999150,1cyclictest0-21swapper/618:02:596
194341999150,15cyclictest0-21swapper/619:47:116
194341999150,14cyclictest0-21swapper/619:24:016
194342299145,7cyclictest2081163-21kthreadcore16:29:137
1943422991413,0cyclictest0-21swapper/717:04:147
194342299141,2cyclictest2562925-21ntpq20:24:227
1943419991413,1cyclictest0-21swapper/619:29:136
1943419991413,1cyclictest0-21swapper/617:09:146
1943419991413,1cyclictest0-21swapper/615:39:226
1943419991413,1cyclictest0-21swapper/615:28:586
1943419991412,2cyclictest0-21swapper/618:36:436
1943419991411,2cyclictest2513133-21kworker/u16:3+flush-8:020:49:136
194341999140,7cyclictest0-21swapper/620:18:426
194341999140,3cyclictest25076101kthreadcore19:59:146
194341999140,14cyclictest0-21swapper/620:22:026
194341999140,14cyclictest0-21swapper/618:21:166
194341999140,14cyclictest0-21swapper/616:31:236
194341999140,0cyclictest0-21swapper/616:54:346
194342299137,5cyclictest589235-21systemd-journal18:33:547
194342299136,6cyclictest0-21swapper/719:49:217
1943422991312,0cyclictest0-21swapper/718:04:107
1943422991310,2cyclictest4175659-21snmpd16:27:387
194342299130,11cyclictest2530815-21grep20:09:177
194341999134,8cyclictest2272112-21tune2fs18:04:106
1943419991312,1cyclictest0-21swapper/620:28:586
1943419991312,1cyclictest0-21swapper/619:34:256
194341999130,4cyclictest19691021irqcore15:34:136
194341999130,3cyclictest22873401kthreadcore18:09:166
194341999130,12cyclictest0-21swapper/619:04:006
194342299129,2cyclictest4175659-21snmpd15:43:377
194342299129,2cyclictest0-21swapper/717:54:207
194342299127,4cyclictest2058540-21latency_hist16:18:557
194342299126,5cyclictest27763-21gvfs-afc-volume17:39:197
194342299125,6cyclictest0-21swapper/719:59:237
194342299120,4cyclictest2032952-21kthreadcore16:04:147
194342299120,3cyclictest939-21systemd-machine20:33:557
194342299120,3cyclictest27642-21gmain18:24:257
194342299120,3cyclictest2423956-21cut19:19:127
194342299120,11cyclictest4175659-21snmpd17:47:397
194342299120,11cyclictest4175659-21snmpd17:12:277
194342299120,11cyclictest21523-21lldpd15:34:177
194341999124,7cyclictest0-21swapper/616:44:126
194341999123,8cyclictest2092084-21cut16:34:146
1943419991210,2cyclictest0-21swapper/615:56:336
194341999120,4cyclictest2179692-21taskset17:16:266
194341999120,1cyclictest0-21swapper/620:05:476
194341999120,12cyclictest0-21swapper/620:25:306
194341999120,12cyclictest0-21swapper/618:40:596
194341999120,12cyclictest0-21swapper/617:25:376
194342299118,2cyclictest4175659-21snmpd18:10:377
194342299118,2cyclictest4175659-21snmpd16:53:297
194342299117,4cyclictest27763-21gvfs-afc-volume15:54:257
194342299116,4cyclictest96-21ksoftirqd/720:49:227
194342299116,4cyclictest0-21swapper/718:19:177
194342299110,4cyclictest2412422-21perf19:13:547
194341999119,2cyclictest0-21swapper/618:29:566
194341999116,4cyclictest0-21swapper/619:49:156
194341999113,7cyclictest2523928-21grep20:09:076
194341999113,7cyclictest2384292-21cut18:59:136
194341999113,7cyclictest2181820-21cut17:19:166
194341999113,7cyclictest2019737-21cut15:59:136
194341999113,7cyclictest1994240-21tr15:44:176
194341999112,8cyclictest2361479-21unixbench_multi18:44:276
194341999112,8cyclictest2226863-21cut17:39:196
194341999112,8cyclictest2156271-21cut17:04:166
194341999110,4cyclictest2595112-21sh20:44:096
194341999110,4cyclictest2584621-21cat20:39:116
194341999110,4cyclictest2467881-21cut19:39:176
194341999110,4cyclictest2423213-21ls19:19:086
194341999110,4cyclictest2413161-21expr19:14:086
194341999110,4cyclictest2373647-21cat18:54:136
194341999110,4cyclictest2119701-21cpuspeed_turbos16:49:096
194341999110,4cyclictest2078555-21chrt16:26:186
194341999110,4cyclictest2056247-21kthreadcore16:14:196
194341999110,4cyclictest2029465-21/usr/sbin/munin16:04:116
194341999110,4cyclictest2003252-21cut15:49:186
194341999110,3cyclictest24045571kthreadcore19:09:146
194342299103,7cyclictest27763-21gvfs-afc-volume18:39:127
194341999100,4cyclictest2574723-21cstates20:34:076
194341999100,4cyclictest2363441-21cut18:49:126
194341999100,4cyclictest2241373-21expr17:49:086
194341999100,4cyclictest2230911-21cat17:44:076
194341999100,4cyclictest2210736-21cat17:34:096
194341999100,4cyclictest2200864-21expr17:29:086
194341999100,4cyclictest2099440-21cat16:39:096
194341999100,4cyclictest2059681-21hddtemp_smartct16:19:136
194341999100,4cyclictest2039131-21expr16:09:096
194341999100,3cyclictest2312982-21cut18:24:136
194341999100,3cyclictest2139972-21cpuspeed_turbos16:59:086
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional