You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-08-30 - 04:20
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Sat Aug 30, 2025 00:50:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
275128652,30sleep70-21swapper/719:06:537
283928349,29sleep30-21swapper/319:08:093
270728248,30sleep50-21swapper/519:06:185
269928248,30sleep60-21swapper/619:06:116
284727945,29sleep20-21swapper/219:08:152
277227743,30sleep10-21swapper/119:07:101
274427742,30sleep00-21swapper/019:06:460
277527439,30sleep40-21swapper/419:07:144
92512540,0sleep30-21swapper/322:10:233
312012530,0sleep70-21swapper/700:10:537
27082480,0sleep60-21swapper/621:20:226
17902460,0sleep10-21swapper/121:20:171
250452440,0sleep50-21swapper/523:36:335
252062430,0sleep20-21swapper/221:15:372
178432430,0sleep70-21swapper/721:44:097
10942410,0sleep011258-21diskmemload21:35:210
340499320,32cyclictest0-21swapper/522:33:105
3403993110,19cyclictest121rcu_preempt00:25:594
3404992828,0cyclictest0-21swapper/522:48:515
3403992811,9cyclictest121rcu_preempt23:10:004
3403992711,14cyclictest121rcu_preempt00:13:214
3403992611,13cyclictest121rcu_preempt23:20:214
3403992610,14cyclictest121rcu_preempt00:02:344
3406992522,3cyclictest0-21swapper/700:05:507
3405992525,0cyclictest0-21swapper/600:05:426
3403992511,12cyclictest121rcu_preempt00:25:004
3403992510,13cyclictest121rcu_preempt23:57:554
3403992510,13cyclictest0-21swapper/423:46:084
3403992510,13cyclictest0-21swapper/423:32:004
3402992525,0cyclictest0-21swapper/300:24:533
3400992525,0cyclictest0-21swapper/122:41:301
3400992525,0cyclictest0-21swapper/120:15:071
3403992413,10cyclictest69450irq/124-eth022:13:154
3403992412,10cyclictest121rcu_preempt00:31:004
3403992410,12cyclictest121rcu_preempt23:54:474
3403992410,11cyclictest0-21swapper/400:05:194
3403992312,9cyclictest121rcu_preempt23:41:574
3403992310,12cyclictest121rcu_preempt23:35:054
3403992310,11cyclictest121rcu_preempt21:51:224
3403992310,11cyclictest0-21swapper/419:25:114
3403992310,10cyclictest121rcu_preempt23:28:554
3403992310,10cyclictest0-21swapper/422:31:514
340699226,12cyclictest0-21swapper/722:45:017
3404992221,1cyclictest561ktimersoftd/523:51:305
3403992218,4cyclictest69450irq/124-eth022:02:414
3403992211,8cyclictest121rcu_preempt20:07:114
3403992211,8cyclictest121rcu_preempt19:45:374
3403992211,7cyclictest121rcu_preempt21:30:144
3403992210,11cyclictest121rcu_preempt22:39:034
3403992210,11cyclictest0-21swapper/420:25:234
3403992210,11cyclictest0-21swapper/420:25:224
3403992210,10cyclictest121rcu_preempt23:14:554
3403992210,10cyclictest121rcu_preempt22:50:224
3403992210,10cyclictest121rcu_preempt21:47:064
3403992210,10cyclictest121rcu_preempt21:18:434
3403992210,10cyclictest121rcu_preempt19:58:314
3403992210,10cyclictest0-21swapper/422:23:464
3403992210,10cyclictest0-21swapper/400:17:244
3400992222,0cyclictest0-21swapper/123:25:271
3399992222,0cyclictest0-21swapper/022:33:510
3399992222,0cyclictest0-21swapper/000:33:290
3404992120,1cyclictest561ktimersoftd/500:32:295
3404992119,1cyclictest561ktimersoftd/523:24:375
3403992111,8cyclictest131rcu_sched19:15:014
3403992111,8cyclictest121rcu_preempt22:55:014
3403992111,8cyclictest121rcu_preempt22:47:524
3403992111,7cyclictest121rcu_preempt23:17:474
3403992111,7cyclictest121rcu_preempt21:55:224
3403992111,6cyclictest121rcu_preempt22:07:084
3403992110,8cyclictest121rcu_preempt22:16:304
3403992110,8cyclictest121rcu_preempt21:09:144
3403992110,8cyclictest121rcu_preempt20:18:154
3403992110,7cyclictest0-21swapper/421:39:274
3403992110,10cyclictest0-21swapper/419:10:014
3403992011,7cyclictest121rcu_preempt21:40:104
3403992011,7cyclictest121rcu_preempt20:53:464
3403992011,7cyclictest121rcu_preempt20:00:154
3403992011,6cyclictest121rcu_preempt23:00:014
3403992011,6cyclictest121rcu_preempt23:00:004
3403992011,6cyclictest121rcu_preempt21:00:144
3403992011,6cyclictest121rcu_preempt20:10:114
3403992011,6cyclictest121rcu_preempt19:50:134
3403992011,6cyclictest121rcu_preempt19:23:194
3403992011,6cyclictest121rcu_preempt00:35:124
3403992010,9cyclictest121rcu_preempt22:42:364
3403992010,7cyclictest121rcu_preempt21:10:134
3403992010,7cyclictest121rcu_preempt20:48:574
3403992010,7cyclictest121rcu_preempt20:42:174
3403992010,7cyclictest121rcu_preempt20:31:204
3403992010,7cyclictest121rcu_preempt19:43:324
3403992010,7cyclictest121rcu_preempt19:32:524
3403992010,7cyclictest0-21swapper/420:55:154
3403992010,6cyclictest121rcu_preempt21:20:354
3403992010,6cyclictest121rcu_preempt20:35:084
3403992010,6cyclictest0-21swapper/422:25:004
3403992010,10cyclictest0-21swapper/421:25:504
3400992019,1cyclictest241ktimersoftd/100:14:301
3399992011,4cyclictest0-21swapper/000:30:000
3399992010,10cyclictest0-21swapper/022:59:420
3404991918,1cyclictest561ktimersoftd/523:46:495
3403991911,5cyclictest121rcu_preempt20:24:124
3403991910,6cyclictest121rcu_preempt19:35:204
3405991810,6cyclictest0-21swapper/619:10:136
3404991817,1cyclictest561ktimersoftd/522:22:485
3404991816,1cyclictest561ktimersoftd/500:15:125
3399991810,2cyclictest0-21swapper/023:32:040
3399991810,0cyclictest0-21swapper/023:26:240
235152184,1sleep10-21swapper/123:35:331
3406991710,6cyclictest0-21swapper/722:36:407
3404991714,1cyclictest19802-21nscd22:38:455
3402991710,0cyclictest0-21swapper/323:15:033
3401991716,1cyclictest734-21gmain23:40:152
3400991710,5cyclictest0-21swapper/122:50:161
3399991710,0cyclictest0-21swapper/022:01:270
3406991610,0cyclictest0-21swapper/723:53:087
3406991610,0cyclictest0-21swapper/723:44:357
3405991613,1cyclictest31128-21ls22:05:216
3404991615,1cyclictest561ktimersoftd/523:25:175
3404991615,1cyclictest561ktimersoftd/523:00:215
3404991615,1cyclictest561ktimersoftd/523:00:215
3404991615,1cyclictest561ktimersoftd/500:37:455
3404991615,1cyclictest561ktimersoftd/500:26:185
3404991615,1cyclictest561ktimersoftd/500:12:575
3404991615,1cyclictest30175-21ssh22:51:515
3404991615,1cyclictest2741-21ssh23:41:255
3404991614,1cyclictest561ktimersoftd/523:05:125
3404991610,0cyclictest0-21swapper/522:27:225
3402991616,0cyclictest0-21swapper/321:29:523
3402991610,0cyclictest0-21swapper/322:51:233
3402991610,0cyclictest0-21swapper/321:51:573
3401991613,3cyclictest1642-21ntpd20:58:302
3401991613,1cyclictest16750irq/126-ahci[0000:35:012
3401991612,1cyclictest16750irq/126-ahci[0023:52:082
3401991610,6cyclictest0-21swapper/220:15:002
3401991610,6cyclictest0-21swapper/200:10:002
3401991610,0cyclictest0-21swapper/223:19:512
3401991610,0cyclictest0-21swapper/200:37:242
3401991610,0cyclictest0-21swapper/200:12:432
3400991610,0cyclictest0-21swapper/121:47:481
3400991610,0cyclictest0-21swapper/121:30:121
3399991610,6cyclictest0-21swapper/000:09:020
3399991610,4cyclictest0-21swapper/019:10:130
1009021610,0sleep60-21swapper/622:42:306
3406991515,0cyclictest0-21swapper/723:21:287
3406991513,1cyclictest662-21ptp4l22:58:347
3406991510,5cyclictest0-21swapper/723:46:567
3406991510,5cyclictest0-21swapper/723:16:107
3406991510,5cyclictest0-21swapper/719:59:217
3406991510,4cyclictest0-21swapper/722:25:147
3406991510,0cyclictest0-21swapper/723:55:297
3406991510,0cyclictest0-21swapper/723:30:197
3406991510,0cyclictest0-21swapper/723:25:167
3406991510,0cyclictest0-21swapper/722:22:047
3406991510,0cyclictest0-21swapper/722:03:157
3406991510,0cyclictest0-21swapper/721:33:457
3406991510,0cyclictest0-21swapper/720:15:007
3406991510,0cyclictest0-21swapper/700:38:007
3406991510,0cyclictest0-21swapper/700:30:067
3406991510,0cyclictest0-21swapper/700:27:217
3406991510,0cyclictest0-21swapper/700:17:457
3405991514,1cyclictest1152-21sshd22:22:316
3405991510,0cyclictest0-21swapper/619:15:026
3405991510,0cyclictest0-21swapper/600:26:456
3405991510,0cyclictest0-21swapper/600:01:326
3404991514,1cyclictest561ktimersoftd/523:11:085
3404991514,1cyclictest561ktimersoftd/522:40:215
3404991514,1cyclictest561ktimersoftd/522:09:205
3404991514,1cyclictest561ktimersoftd/521:55:295
3404991514,1cyclictest561ktimersoftd/521:45:245
3404991514,1cyclictest561ktimersoftd/521:17:415
3404991514,1cyclictest561ktimersoftd/520:10:135
3404991513,1cyclictest24078-21sed19:40:225
3404991510,0cyclictest0-21swapper/523:58:175
3404991510,0cyclictest0-21swapper/500:04:335
3402991510,3cyclictest0-21swapper/300:25:303
3402991510,2cyclictest0-21swapper/323:11:353
3402991510,1cyclictest11258-21diskmemload23:20:353
3402991510,0cyclictest0-21swapper/323:48:003
3402991510,0cyclictest0-21swapper/322:39:443
3402991510,0cyclictest0-21swapper/322:00:073
3402991510,0cyclictest0-21swapper/321:34:383
3402991510,0cyclictest0-21swapper/300:10:113
340199152,9cyclictest1-21systemd23:21:252
3401991515,0cyclictest0-21swapper/222:50:192
3401991514,1cyclictest5196-21nscd22:44:302
3401991510,5cyclictest0-21swapper/219:31:342
3401991510,5cyclictest0-21swapper/219:20:172
3401991510,1cyclictest0-21swapper/223:12:522
3401991510,0cyclictest0-21swapper/223:47:242
3401991510,0cyclictest0-21swapper/223:09:362
3401991510,0cyclictest0-21swapper/222:49:172
3401991510,0cyclictest0-21swapper/222:38:342
3401991510,0cyclictest0-21swapper/221:53:042
3401991510,0cyclictest0-21swapper/200:21:532
3401991510,0cyclictest0-21swapper/200:17:012
3401991510,0cyclictest0-21swapper/200:00:282
3400991513,1cyclictest14325-21ssh21:26:051
3400991510,5cyclictest0-21swapper/123:22:371
3400991510,5cyclictest0-21swapper/122:32:011
3400991510,5cyclictest0-21swapper/100:35:051
3400991510,5cyclictest0-21swapper/100:09:091
3400991510,0cyclictest0-21swapper/123:07:431
3400991510,0cyclictest0-21swapper/122:28:381
3400991510,0cyclictest0-21swapper/122:01:301
3400991510,0cyclictest0-21swapper/121:10:221
3400991510,0cyclictest0-21swapper/100:27:131
3399991514,1cyclictest6403-21munin-node22:36:110
3399991514,1cyclictest2466-21ls21:20:210
3399991510,5cyclictest0-21swapper/023:48:490
3399991510,5cyclictest0-21swapper/023:21:520
3399991510,5cyclictest0-21swapper/022:10:270
3399991510,5cyclictest0-21swapper/021:50:170
3399991510,2cyclictest0-21swapper/022:05:110
3399991510,0cyclictest0-21swapper/023:43:330
3399991510,0cyclictest0-21swapper/023:16:160
3399991510,0cyclictest0-21swapper/023:01:550
3399991510,0cyclictest0-21swapper/023:01:550
3399991510,0cyclictest0-21swapper/022:40:290
3399991510,0cyclictest0-21swapper/022:18:310
1116021510,4sleep20-21swapper/221:08:502
1064321510,0sleep30-21swapper/322:42:503
3406991414,0cyclictest0-21swapper/722:52:027
3406991413,1cyclictest641-21nscd21:16:047
3406991410,0cyclictest0-21swapper/723:11:007
3406991410,0cyclictest0-21swapper/723:06:077
3406991410,0cyclictest0-21swapper/723:03:507
3406991410,0cyclictest0-21swapper/723:03:497
3406991410,0cyclictest0-21swapper/722:15:167
3406991410,0cyclictest0-21swapper/721:59:017
3406991410,0cyclictest0-21swapper/721:51:017
3406991410,0cyclictest0-21swapper/721:24:557
3406991410,0cyclictest0-21swapper/721:11:017
3406991410,0cyclictest0-21swapper/720:45:247
3406991410,0cyclictest0-21swapper/720:20:167
3406991410,0cyclictest0-21swapper/720:10:157
3406991410,0cyclictest0-21swapper/719:45:197
3406991410,0cyclictest0-21swapper/700:20:257
3406991410,0cyclictest0-21swapper/700:00:217
3405991413,0cyclictest14369-1kworker/u17:122:31:146
3405991412,1cyclictest1142-21switchtime21:35:216
3405991411,2cyclictest9034-21sh22:25:556
3405991410,4cyclictest0-21swapper/622:50:406
3405991410,4cyclictest0-21swapper/600:38:026
3405991410,4cyclictest0-21swapper/600:31:576
3405991410,3cyclictest0-21swapper/623:12:106
3405991410,0cyclictest0-21swapper/623:56:136
3405991410,0cyclictest0-21swapper/623:54:456
3405991410,0cyclictest0-21swapper/623:45:446
3405991410,0cyclictest0-21swapper/623:39:086
3405991410,0cyclictest0-21swapper/623:30:406
3405991410,0cyclictest0-21swapper/623:28:156
3405991410,0cyclictest0-21swapper/623:21:276
3405991410,0cyclictest0-21swapper/622:35:146
3405991410,0cyclictest0-21swapper/622:13:576
3405991410,0cyclictest0-21swapper/622:02:176
3405991410,0cyclictest0-21swapper/621:43:116
3405991410,0cyclictest0-21swapper/600:23:326
3405991410,0cyclictest0-21swapper/600:19:016
340499149,1cyclictest4580-21ls20:55:235
340499147,1cyclictest0-21swapper/522:55:215
3404991413,1cyclictest561ktimersoftd/523:33:415
3404991413,1cyclictest561ktimersoftd/522:02:055
3404991413,1cyclictest561ktimersoftd/521:52:205
3404991413,1cyclictest561ktimersoftd/521:25:015
3404991413,1cyclictest561ktimersoftd/520:35:215
3404991413,1cyclictest561ktimersoftd/519:55:175
3404991412,1cyclictest561ktimersoftd/522:10:165
3404991412,1cyclictest4246-21users20:00:235
3404991412,1cyclictest28612-21chrt20:43:385
3404991411,0cyclictest121rcu_preempt21:35:165
3404991410,4cyclictest0-21swapper/523:15:175
3404991410,4cyclictest0-21swapper/521:40:215
3404991410,4cyclictest0-21swapper/500:06:445
3404991410,2cyclictest57-21ksoftirqd/519:10:015
3404991410,0cyclictest0-21swapper/520:20:215
3404991410,0cyclictest0-21swapper/500:21:075
3402991414,0cyclictest0-21swapper/322:25:073
3402991414,0cyclictest0-21swapper/300:00:143
3402991413,1cyclictest11258-21diskmemload00:06:423
3402991410,4cyclictest0-21swapper/321:55:133
3402991410,0cyclictest0-21swapper/323:56:363
3402991410,0cyclictest0-21swapper/323:35:483
3402991410,0cyclictest0-21swapper/323:27:493
3402991410,0cyclictest0-21swapper/323:03:143
3402991410,0cyclictest0-21swapper/323:03:133
3402991410,0cyclictest0-21swapper/322:45:313
3402991410,0cyclictest0-21swapper/322:20:333
3402991410,0cyclictest0-21swapper/321:40:493
3402991410,0cyclictest0-21swapper/321:36:223
3402991410,0cyclictest0-21swapper/321:16:333
3402991410,0cyclictest0-21swapper/320:00:243
3402991410,0cyclictest0-21swapper/300:30:333
3402991410,0cyclictest0-21swapper/300:15:103
3401991414,0cyclictest14369-1kworker/u17:122:30:162
3401991414,0cyclictest0-21swapper/222:00:472
3401991414,0cyclictest0-21swapper/221:39:092
3401991413,1cyclictest16702-21nscd21:45:582
3401991410,4cyclictest0-21swapper/223:03:322
3401991410,4cyclictest0-21swapper/223:03:312
3401991410,4cyclictest0-21swapper/222:05:562
3401991410,2cyclictest0-21swapper/223:25:082
3401991410,0cyclictest0-21swapper/223:58:212
3401991410,0cyclictest0-21swapper/223:36:132
3401991410,0cyclictest0-21swapper/223:30:352
3401991410,0cyclictest0-21swapper/222:59:552
3401991410,0cyclictest0-21swapper/222:15:272
3401991410,0cyclictest0-21swapper/222:10:432
3401991410,0cyclictest0-21swapper/221:31:492
3401991410,0cyclictest0-21swapper/200:25:462
3400991414,0cyclictest0-21swapper/123:12:231
3400991412,2cyclictest0-21swapper/100:30:201
3400991411,3cyclictest14670-21sh22:45:041
3400991410,4cyclictest0-21swapper/123:31:551
3400991410,4cyclictest0-21swapper/123:15:211
3400991410,4cyclictest0-21swapper/123:04:271
3400991410,4cyclictest0-21swapper/123:04:271
3400991410,4cyclictest0-21swapper/119:50:151
3400991410,3cyclictest0-21swapper/123:50:161
3400991410,0cyclictest0-21swapper/123:56:091
3400991410,0cyclictest0-21swapper/123:45:161
3400991410,0cyclictest0-21swapper/123:41:591
3400991410,0cyclictest0-21swapper/122:55:291
3400991410,0cyclictest0-21swapper/122:37:151
3400991410,0cyclictest0-21swapper/122:15:481
3400991410,0cyclictest0-21swapper/122:11:561
3400991410,0cyclictest0-21swapper/122:05:121
3400991410,0cyclictest0-21swapper/121:53:171
3400991410,0cyclictest0-21swapper/121:18:041
3400991410,0cyclictest0-21swapper/121:00:161
3400991410,0cyclictest0-21swapper/120:10:171
3400991410,0cyclictest0-21swapper/119:10:181
3400991410,0cyclictest0-21swapper/100:16:511
3400991410,0cyclictest0-21swapper/100:04:441
3399991414,0cyclictest0-21swapper/021:49:400
3399991414,0cyclictest0-21swapper/000:15:320
3399991414,0cyclictest0-21swapper/000:01:020
3399991413,1cyclictest699-21ssh00:12:080
3399991410,2cyclictest0-21swapper/000:35:030
3399991410,0cyclictest0-21swapper/023:51:040
3399991410,0cyclictest0-21swapper/023:37:560
3399991410,0cyclictest0-21swapper/023:10:240
3399991410,0cyclictest0-21swapper/022:50:230
3399991410,0cyclictest0-21swapper/022:25:200
3399991410,0cyclictest0-21swapper/000:20:190
141921410,0sleep60-21swapper/600:12:386
3406991311,1cyclictest0-21swapper/721:35:197
3406991310,3cyclictest0-21swapper/722:31:087
3406991310,3cyclictest0-21swapper/721:05:137
3406991310,3cyclictest0-21swapper/721:00:127
3406991310,3cyclictest0-21swapper/720:50:187
3406991310,3cyclictest0-21swapper/719:22:477
3406991310,1cyclictest0-21swapper/721:25:187
3406991310,0cyclictest0-21swapper/723:35:127
3406991310,0cyclictest0-21swapper/722:40:127
3406991310,0cyclictest0-21swapper/722:05:147
3406991310,0cyclictest0-21swapper/721:45:237
3406991310,0cyclictest0-21swapper/720:37:577
3406991310,0cyclictest0-21swapper/719:55:007
3406991310,0cyclictest0-21swapper/719:30:117
3406991310,0cyclictest0-21swapper/719:25:117
3406991310,0cyclictest0-21swapper/719:15:207
3405991311,1cyclictest1642-21ntpd23:05:186
3405991310,3cyclictest0-21swapper/621:00:176
3405991310,3cyclictest0-21swapper/620:05:206
3405991310,1cyclictest23793-21sh19:40:216
3405991310,1cyclictest0-21swapper/621:52:076
3405991310,0cyclictest0-21swapper/623:42:276
3405991310,0cyclictest0-21swapper/623:15:136
3405991310,0cyclictest0-21swapper/623:01:546
3405991310,0cyclictest0-21swapper/623:01:546
3405991310,0cyclictest0-21swapper/622:57:016
3405991310,0cyclictest0-21swapper/622:15:216
3405991310,0cyclictest0-21swapper/621:45:246
3405991310,0cyclictest0-21swapper/621:32:236
3405991310,0cyclictest0-21swapper/621:25:156
3405991310,0cyclictest0-21swapper/621:19:076
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional