You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-08 - 11:38
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot0.osadl.org (updated Sat Nov 08, 2025 00:45:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2125921500,0sleep721225-21sshd23:34:417
924921400,3sleep21929999cyclictest23:46:322
520921120,0sleep10-21swapper/121:22:031
122482850,1sleep5591ktimersoftd/523:43:385
107922840,1sleep5660-21dbus-daemon23:23:425
240622830,4sleep31930499cyclictest23:31:343
322752820,0sleep40-21swapper/400:15:024
239422810,4sleep71933199cyclictest21:10:557
198162790,0sleep30-21swapper/322:41:403
116932780,0sleep70-21swapper/723:03:567
250502770,0sleep00-21swapper/023:54:460
292172760,0sleep70-21swapper/721:47:117
94462740,0sleep20-21swapper/221:00:172
58782730,0sleep30-21swapper/322:53:273
57672730,0sleep30-21swapper/323:29:493
84382720,0sleep70-21swapper/723:26:417
155022710,0sleep70-21swapper/721:55:277
9622700,1sleep6671rcuc/623:19:266
9622700,1sleep6671rcuc/623:19:266
50952700,0sleep00-21swapper/023:19:530
50952700,0sleep00-21swapper/023:19:520
238562700,1sleep60-21swapper/600:04:236
312932690,0sleep20-21swapper/222:03:402
38872660,0sleep50-21swapper/523:09:485
29352660,1sleep11929399cyclictest22:49:551
133312660,1sleep41036-21runrttasks21:22:544
148342620,0sleep00-21swapper/000:33:090
148342620,0sleep00-21swapper/000:33:090
55572590,0sleep70-21swapper/720:54:457
1879225949,6sleep60-21swapper/619:06:456
1879225949,6sleep60-21swapper/619:06:456
1880025848,6sleep10-21swapper/119:06:481
1880025848,6sleep10-21swapper/119:06:481
1877525747,6sleep70-21swapper/719:06:307
1877525747,6sleep70-21swapper/719:06:307
1898325241,7sleep50-21swapper/519:09:005
1898325241,7sleep50-21swapper/519:09:005
1901825141,6sleep40-21swapper/419:09:234
1901825141,6sleep40-21swapper/419:09:234
1902524928,7sleep00-21swapper/019:09:270
1902524928,7sleep00-21swapper/019:09:270
1871424725,7sleep30-21swapper/319:05:463
1871424725,7sleep30-21swapper/319:05:463
195202460,4sleep61932599cyclictest22:48:176
133362430,3sleep11929399cyclictest22:21:191
67862420,1sleep06783-21sshd22:37:050
1904524130,7sleep20-21swapper/219:09:452
1904524130,7sleep20-21swapper/219:09:452
288712260,1sleep00-21swapper/022:52:270
89312220,4sleep61932599cyclictest21:32:106
168312220,0sleep40-21swapper/421:13:334
203352210,0sleep20-21swapper/223:27:562
1928799208,6cyclictest660-21dbus-daemon23:37:200
19142200,1sleep30-21swapper/322:56:143
164412200,0sleep50-21swapper/500:30:025
164412200,0sleep50-21swapper/500:30:025
88952190,0sleep30-21swapper/323:00:153
246982190,1sleep3411ktimersoftd/321:59:483
1928799190,12cyclictest6452-21sshd22:40:190
155352190,1sleep50-21swapper/522:44:395
94992180,1sleep39488-21sshd22:11:113
57682180,0sleep30-21swapper/300:25:273
288702180,1sleep50-21swapper/521:47:085
283042180,0sleep60-21swapper/600:34:366
283042180,0sleep60-21swapper/600:34:356
246772180,1sleep70-21swapper/722:25:427
236922180,0sleep20-21swapper/222:38:502
1929399180,1cyclictest91rcu_preempt23:19:221
1929399180,1cyclictest91rcu_preempt23:19:221
188762180,0sleep00-21swapper/023:57:190
1932599170,16cyclictest0-21swapper/622:21:496
1928799170,13cyclictest660-21dbus-daemon22:10:150
148692170,0sleep50-21swapper/522:08:325
301552160,0sleep10-21swapper/100:14:511
1929399162,12cyclictest0-21swapper/123:53:011
1929399160,5cyclictest0-21swapper/100:33:331
1929399160,5cyclictest0-21swapper/100:33:321
1929399160,15cyclictest26038-21sshd21:11:081
1929399160,13cyclictest0-21swapper/119:11:401
12672160,0sleep10-21swapper/123:35:481
122512160,0sleep00-21swapper/021:35:420
275002150,1sleep30-21swapper/322:29:223
1933199150,1cyclictest0-21swapper/723:54:467
1933199150,14cyclictest0-21swapper/722:32:277
19325991512,2cyclictest0-21swapper/622:37:256
19325991511,2cyclictest0-21swapper/621:27:326
1932599150,2cyclictest778-21gdbus22:19:336
19317991513,1cyclictest591ktimersoftd/522:29:595
1931799150,2cyclictest660-21dbus-daemon21:11:315
1930499150,13cyclictest662-21gdbus00:31:113
1930499150,13cyclictest662-21gdbus00:31:103
1930499150,13cyclictest0-21swapper/322:09:383
1929999150,13cyclictest0-21swapper/222:55:542
1929399157,1cyclictest24-21ksoftirqd/121:15:191
1929399150,1cyclictest0-21swapper/100:39:321
1929399150,13cyclictest0-21swapper/122:16:551
1929399150,13cyclictest0-21swapper/121:56:371
119512150,0sleep10-21swapper/122:40:501
19331991411,1cyclictest0-21swapper/722:02:297
1933199140,2cyclictest14438-21systemd-cgroups21:26:137
1933199140,12cyclictest0-21swapper/722:35:417
1933199140,12cyclictest0-21swapper/721:53:297
1933199140,12cyclictest0-21swapper/700:17:107
19325991413,0cyclictest537-40kipmi020:55:146
19325991410,2cyclictest0-21swapper/600:15:416
1932599140,2cyclictest0-21swapper/623:34:416
1932599140,12cyclictest0-21swapper/623:22:356
1932599140,12cyclictest0-21swapper/621:23:306
19317991411,2cyclictest0-21swapper/523:50:145
19310991411,2cyclictest0-21swapper/423:44:234
19310991411,1cyclictest19079-21sshd23:21:084
1931099140,2cyclictest0-21swapper/400:01:374
1931099140,1cyclictest0-21swapper/421:57:484
1931099140,12cyclictest0-21swapper/423:50:594
1931099140,12cyclictest0-21swapper/423:19:084
1931099140,12cyclictest0-21swapper/423:19:074
1931099140,12cyclictest0-21swapper/421:36:424
1930499140,12cyclictest704-21systemd-logind22:47:243
19299991412,1cyclictest27748-21sshd23:15:242
19299991412,1cyclictest27748-21sshd23:15:232
1929999140,12cyclictest3675-21sshd21:31:372
1929399143,10cyclictest0-21swapper/120:40:151
1929399143,10cyclictest0-21swapper/120:40:151
1929399141,4cyclictest101rcu_sched00:28:431
1929399140,8cyclictest0-21swapper/123:40:211
1929399140,12cyclictest660-21dbus-daemon21:47:051
1929399140,12cyclictest0-21swapper/121:29:201
1928799144,5cyclictest29970-21idleruntime-cro00:05:010
19287991410,2cyclictest26403-21idleruntime23:25:140
1928799140,12cyclictest23152-21bash22:25:310
1928799140,12cyclictest0-21swapper/022:30:370
1928799140,12cyclictest0-21swapper/000:05:230
124452140,0sleep70-21swapper/721:05:187
271692130,0sleep10-21swapper/122:06:271
19331991311,1cyclictest23714-21grep22:22:237
19331991311,1cyclictest14215-21sshd00:06:347
19331991311,1cyclictest0-21swapper/722:12:117
19331991311,1cyclictest0-21swapper/700:35:517
1933199130,1cyclictest32276-21grep23:15:547
1933199130,1cyclictest32276-21grep23:15:537
1933199130,12cyclictest13375-21sshd23:37:077
1933199130,12cyclictest0-21swapper/721:32:477
1933199130,11cyclictest0-21swapper/722:55:357
19325991311,1cyclictest7905-21systemd-cgroups23:26:386
19325991311,1cyclictest660-21dbus-daemon22:14:586
19325991311,1cyclictest16616-21sshd21:36:086
19325991310,1cyclictest0-21swapper/622:09:536
1932599130,1cyclictest0-21swapper/621:50:146
1932599130,11cyclictest0-21swapper/600:21:436
1931799131,1cyclictest60-21ksoftirqd/500:12:325
19317991311,1cyclictest7764-21sshd23:36:325
19317991311,1cyclictest591ktimersoftd/521:41:145
19317991311,1cyclictest0-21swapper/500:28:415
19317991310,2cyclictest0-21swapper/523:17:505
19317991310,2cyclictest0-21swapper/523:17:505
19317991310,2cyclictest0-21swapper/522:17:135
19317991310,2cyclictest0-21swapper/500:38:455
1931799130,1cyclictest660-21dbus-daemon21:25:275
1931799130,1cyclictest0-21swapper/522:00:255
1931799130,1cyclictest0-21swapper/521:39:205
1931799130,1cyclictest0-21swapper/521:32:445
1931799130,12cyclictest1-21systemd22:35:065
1931799130,12cyclictest0-21swapper/523:11:155
1931799130,12cyclictest0-21swapper/521:56:565
1931799130,12cyclictest0-21swapper/519:35:155
1931099139,2cyclictest0-21swapper/421:50:494
1931099138,3cyclictest0-21swapper/422:43:064
1931099131,11cyclictest12557-21sshd21:48:484
1931099130,12cyclictest0-21swapper/420:55:104
1930499138,1cyclictest26935-21sshd22:32:333
19304991311,1cyclictest0-21swapper/323:35:313
19304991310,2cyclictest0-21swapper/322:37:443
1930499130,1cyclictest0-21swapper/300:37:143
1930499130,12cyclictest8875-21sshd21:35:223
1930499130,12cyclictest704-21systemd-logind23:44:403
1930499130,12cyclictest0-21swapper/321:53:303
1930499130,11cyclictest0-21swapper/323:55:503
19299991311,1cyclictest0-21swapper/222:51:202
1929999130,12cyclictest0-21swapper/223:43:362
1929999130,12cyclictest0-21swapper/223:12:112
1929999130,12cyclictest0-21swapper/222:41:272
1929999130,12cyclictest0-21swapper/221:27:232
1929999130,12cyclictest0-21swapper/221:18:592
1929999130,12cyclictest0-21swapper/200:17:292
1929399134,1cyclictest24-21ksoftirqd/122:35:001
19293991311,1cyclictest0-21swapper/100:04:111
1929399130,8cyclictest0-21swapper/122:03:131
1929399130,1cyclictest91rcu_preempt00:20:321
1929399130,1cyclictest24-21ksoftirqd/100:06:111
1929399130,12cyclictest0-21swapper/123:58:121
1929399130,12cyclictest0-21swapper/122:59:481
1929399130,12cyclictest0-21swapper/122:10:361
1929399130,12cyclictest0-21swapper/121:51:071
1929399130,12cyclictest0-21swapper/121:38:281
1929399130,12cyclictest0-21swapper/121:32:361
1928799135,2cyclictest17335-21rm23:24:240
19287991311,1cyclictest0-21swapper/023:44:100
19287991311,1cyclictest0-21swapper/021:49:050
19287991310,2cyclictest0-21swapper/000:35:380
1928799130,2cyclictest0-21swapper/021:52:350
1928799130,1cyclictest0-21swapper/000:13:270
19331991210,1cyclictest13664-21sshd00:13:087
19331991210,1cyclictest0-21swapper/722:51:027
19331991210,1cyclictest0-21swapper/722:40:487
19331991210,1cyclictest0-21swapper/721:18:087
1933199120,1cyclictest0-21swapper/723:59:587
1933199120,1cyclictest0-21swapper/723:20:487
1933199120,1cyclictest0-21swapper/722:45:547
1933199120,11cyclictest0-21swapper/722:19:507
19325991210,1cyclictest0-21swapper/623:41:486
19325991210,1cyclictest0-21swapper/623:37:146
1932599120,1cyclictest15756-21sshd23:50:246
1932599120,1cyclictest0-21swapper/600:35:506
1932599120,11cyclictest0-21swapper/622:58:476
1932599120,11cyclictest0-21swapper/622:54:136
1932599120,11cyclictest0-21swapper/621:19:296
1931799129,1cyclictest0-21swapper/522:54:595
1931799122,4cyclictest1-21systemd00:21:285
1931799122,3cyclictest60-21ksoftirqd/521:16:535
1931799121,3cyclictest0-21swapper/523:00:195
1931799121,2cyclictest10066-21sshd22:11:145
1931799121,1cyclictest591ktimersoftd/522:24:035
19317991210,1cyclictest0-21swapper/523:31:575
19317991210,1cyclictest0-21swapper/500:05:255
1931799120,1cyclictest60-21ksoftirqd/500:04:215
1931799120,1cyclictest5700-21sshd21:22:075
1931799120,1cyclictest0-21swapper/523:58:155
1931799120,1cyclictest0-21swapper/523:45:405
1931799120,1cyclictest0-21swapper/522:57:005
1931799120,1cyclictest0-21swapper/522:32:325
1931799120,1cyclictest0-21swapper/500:18:045
1931799120,11cyclictest0-21swapper/523:25:545
1931799120,11cyclictest0-21swapper/522:45:195
1931799120,11cyclictest0-21swapper/521:51:255
1931099123,2cyclictest662-21gdbus23:35:124
19310991210,1cyclictest5439-21sshd23:06:294
19310991210,1cyclictest0-21swapper/422:52:474
19310991210,1cyclictest0-21swapper/421:30:084
19310991210,1cyclictest0-21swapper/420:10:174
19310991210,1cyclictest0-21swapper/400:38:264
19310991210,1cyclictest0-21swapper/400:30:234
19310991210,1cyclictest0-21swapper/400:30:224
1931099120,1cyclictest0-21swapper/423:59:364
1931099120,1cyclictest0-21swapper/423:25:104
1931099120,1cyclictest0-21swapper/422:35:274
1931099120,1cyclictest0-21swapper/421:28:064
1931099120,11cyclictest0-21swapper/422:22:404
1931099120,11cyclictest0-21swapper/422:04:484
1931099120,11cyclictest0-21swapper/400:24:194
1930499129,1cyclictest1049-21snmpd00:15:023
1930499129,1cyclictest0-21swapper/322:22:243
19304991210,1cyclictest28053-21bash21:30:473
19304991210,1cyclictest1-21systemd23:10:473
19304991210,1cyclictest0-21swapper/323:49:143
19304991210,1cyclictest0-21swapper/323:19:253
19304991210,1cyclictest0-21swapper/323:19:243
19304991210,1cyclictest0-21swapper/321:46:003
19304991210,1cyclictest0-21swapper/321:41:573
19304991210,1cyclictest0-21swapper/321:16:083
19304991210,1cyclictest0-21swapper/319:20:173
19304991210,1cyclictest0-21swapper/300:23:073
1930499120,1cyclictest0-21swapper/323:08:143
1930499120,1cyclictest0-21swapper/300:06:273
1930499120,11cyclictest0-21swapper/323:21:253
1929999129,2cyclictest0-21swapper/219:40:202
19299991210,1cyclictest26632-21latency_hist19:25:012
19299991210,1cyclictest0-21swapper/221:46:492
19299991210,1cyclictest0-21swapper/221:42:482
19299991210,1cyclictest0-21swapper/200:37:392
19299991210,1cyclictest0-21swapper/200:06:532
1929999120,1cyclictest25306-21sshd21:14:252
1929999120,1cyclictest16467-21ntp_states00:00:172
1929999120,1cyclictest0-21swapper/222:07:562
1929999120,1cyclictest0-21swapper/221:57:502
1929999120,11cyclictest24438-21id22:48:472
1929999120,11cyclictest0-21swapper/221:54:202
1929999120,11cyclictest0-21swapper/221:36:122
1929399126,2cyclictest24-21ksoftirqd/122:36:021
1929399123,1cyclictest24-21ksoftirqd/123:45:191
1929399123,1cyclictest24-21ksoftirqd/122:27:061
1929399122,6cyclictest24-21ksoftirqd/123:00:101
1929399121,1cyclictest24-21ksoftirqd/121:41:201
19293991210,1cyclictest0-21swapper/119:40:061
1929399120,5cyclictest0-21swapper/123:20:281
1929399120,3cyclictest13912-21sshd23:33:551
1929399120,1cyclictest9449-21sshd23:06:561
1929399120,11cyclictest0-21swapper/120:11:181
1929399120,11cyclictest0-21swapper/119:22:461
19287991210,1cyclictest0-21swapper/021:30:240
19287991210,1cyclictest0-21swapper/021:16:180
19287991210,1cyclictest0-21swapper/020:40:000
1928799120,1cyclictest16100-21systemd-cgroups21:26:220
1928799120,1cyclictest0-21swapper/022:20:240
1928799120,11cyclictest0-21swapper/023:14:500
1933199119,1cyclictest0-21swapper/722:09:377
1933199119,1cyclictest0-21swapper/700:27:477
1933199110,1cyclictest0-21swapper/721:20:097
1932599119,1cyclictest28563-21grepconf.sh21:11:246
1932599119,1cyclictest17515-21sshd23:14:326
1932599119,1cyclictest0-21swapper/623:59:006
1932599119,1cyclictest0-21swapper/621:57:466
1932599110,1cyclictest0-21swapper/623:07:566
1932599110,1cyclictest0-21swapper/600:25:456
1932599110,10cyclictest0-21swapper/621:41:206
1932599110,10cyclictest0-21swapper/619:25:136
1931099119,1cyclictest0-21swapper/423:01:564
1931099119,1cyclictest0-21swapper/422:10:264
1931099119,1cyclictest0-21swapper/421:18:014
1931099119,1cyclictest0-21swapper/400:12:144
1931099118,2cyclictest0-21swapper/422:57:224
1931099110,10cyclictest11220-21sshd22:34:174
1930499119,1cyclictest0-21swapper/321:10:383
1930499117,2cyclictest1060-21in:imjournal00:00:233
1930499110,1cyclictest0-21swapper/322:17:183
1930499110,1cyclictest0-21swapper/321:24:593
1930499110,1cyclictest0-21swapper/319:15:183
1929999119,1cyclictest0-21swapper/223:51:422
1929999119,1cyclictest0-21swapper/223:05:342
1929399114,4cyclictest24-21ksoftirqd/123:11:371
1929399111,1cyclictest101rcu_sched00:15:311
1929399110,4cyclictest662-21gdbus22:51:571
1929399110,4cyclictest0-21swapper/119:50:181
1929399110,3cyclictest101rcu_sched23:25:531
1929399110,2cyclictest0-21swapper/119:55:161
1929399110,2cyclictest0-21swapper/119:15:181
1929399110,1cyclictest0-21swapper/119:35:131
1929399110,10cyclictest0-21swapper/119:31:141
1928799119,1cyclictest1117-21nfsd23:03:520
1928799119,1cyclictest0-21swapper/022:47:580
1928799113,5cyclictest0-21swapper/019:23:560
1928799110,1cyclictest0-21swapper/022:01:350
1933199108,1cyclictest0-21swapper/723:11:527
1933199104,5cyclictest0-21swapper/719:43:577
1933199103,5cyclictest0-21swapper/719:50:547
1933199100,0cyclictest0-21swapper/723:44:147
1932599108,1cyclictest28696-21cat20:35:156
1932599108,1cyclictest0-21swapper/623:46:236
1932599108,1cyclictest0-21swapper/623:01:216
1932599108,1cyclictest0-21swapper/622:30:186
1932599103,4cyclictest0-21swapper/600:11:296
1932599100,0cyclictest0-21swapper/622:02:456
1931799108,1cyclictest0-21swapper/520:40:115
1931799108,1cyclictest0-21swapper/520:40:115
1931099108,1cyclictest660-21dbus-daemon23:31:144
1931099108,1cyclictest0-21swapper/420:35:254
1931099108,1cyclictest0-21swapper/419:17:274
1931099103,1cyclictest24378-21rm22:15:544
1931099103,1cyclictest0-21swapper/422:48:534
1931099100,1cyclictest0-21swapper/400:25:344
1930499108,1cyclictest0-21swapper/321:26:463
1929999108,1cyclictest21414-21grepconf.sh23:37:582
1929999108,1cyclictest0-21swapper/223:01:002
1929999108,1cyclictest0-21swapper/222:23:462
1929999108,1cyclictest0-21swapper/200:32:092
1929999108,1cyclictest0-21swapper/200:32:082
1929999107,2cyclictest704-21systemd-logind22:18:402
1929999103,1cyclictest0-21swapper/200:21:452
1929999100,2cyclictest0-21swapper/223:21:132
1929399101,1cyclictest24-21ksoftirqd/121:00:001
1928799108,1cyclictest0-21swapper/023:30:580
1928799108,1cyclictest0-21swapper/022:15:510
1928799103,1cyclictest18061-21id21:20:110
1928799100,9cyclictest0-21swapper/019:50:080
1928799100,1cyclictest0-21swapper/021:13:100
106662100,2sleep60-21swapper/621:45:176
9190290,0sleep30-21swapper/319:55:123
193319997,1cyclictest0-21swapper/723:05:157
193319997,1cyclictest0-21swapper/719:11:077
193319993,5cyclictest0-21swapper/721:39:367
193319993,5cyclictest0-21swapper/720:46:047
193319993,5cyclictest0-21swapper/720:05:007
193319993,5cyclictest0-21swapper/720:00:247
193319991,2cyclictest30003-21sshd00:21:207
193319990,5cyclictest0-21swapper/719:55:157
193319990,2cyclictest8925-21bash21:41:537
193319990,2cyclictest3972-21sshd00:32:007
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional