You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-28 - 14:09
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Tue Apr 28, 2026 00:54:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
333997210,42cyclictest0-21swapper/021:13:210
3339969760,634cyclictest0-21swapper/022:08:300
33599691648,41cyclictest321ktimersoftd/222:08:332
334996790,42cyclictest0-21swapper/119:53:571
34099677591,84cyclictest711rcuc/700:13:397
34099677591,84cyclictest711rcuc/700:13:397
3349964911,380cyclictest0-21swapper/121:18:311
3359964853,380cyclictest0-21swapper/200:39:282
33999613569,42cyclictest631rcuc/621:14:536
3349961217,592cyclictest0-21swapper/123:16:501
33399608268,338cyclictest5307-21kworker/u16:121:16:440
333995961,592cyclictest0-21swapper/022:24:120
336995940,84cyclictest0-21swapper/322:54:083
334995940,42cyclictest0-21swapper/123:29:091
334995940,42cyclictest0-21swapper/122:51:521
338995930,83cyclictest0-21swapper/522:54:095
337995930,84cyclictest0-21swapper/422:54:094
334995930,42cyclictest0-21swapper/100:11:121
334995930,42cyclictest0-21swapper/100:11:121
3349959180,508cyclictest0-21swapper/119:22:081
334995900,39cyclictest0-21swapper/121:13:081
3339958333,3cyclictest0-21swapper/021:55:360
3339958333,3cyclictest0-21swapper/021:55:360
3349958028,549cyclictest0-21swapper/100:00:111
3359957828,253cyclictest33-21ksoftirqd/223:20:202
33799570231,84cyclictest24585-21kworker/u16:000:36:534
33599567183,381cyclictest722-21nscd00:09:122
3339956715,549cyclictest15846-21runrttasks23:14:560
33599564184,296cyclictest713-21in:imuxsock22:51:012
333995596,42cyclictest0-21swapper/021:52:470
33699558219,84cyclictest19077-21kworker/u16:321:54:123
33599557474,3cyclictest311rcuc/200:11:272
33599557474,3cyclictest311rcuc/200:11:262
333995520,41cyclictest0-21swapper/023:15:370
33799551209,339cyclictest64450irq/122-eth000:10:284
33799551209,339cyclictest64450irq/122-eth000:10:274
3349955183,465cyclictest12500-21ssh22:56:041
334995510,36cyclictest21492-21runrttasks22:07:561
333995510,42cyclictest0-21swapper/023:39:290
333995501,386cyclictest0-21swapper/022:51:460
3349954939,507cyclictest26102-21ssh21:53:551
333995480,41cyclictest0-21swapper/022:10:130
3339954737,507cyclictest0-21swapper/019:24:320
3339954534,508cyclictest0-21swapper/000:09:110
3349954433,338cyclictest0-21swapper/121:55:031
3349954433,338cyclictest0-21swapper/121:55:031
3339954434,507cyclictest0-21swapper/023:20:180
3339954134,427cyclictest0-21swapper/020:54:540
3349954030,424cyclictest0-21swapper/123:20:031
3339954030,126cyclictest0-21swapper/023:27:230
34099538119,416cyclictest0-21swapper/721:54:097
3379953830,92cyclictest0-21swapper/400:09:114
3379953630,48cyclictest0-21swapper/423:20:194
3339953424,464cyclictest24669-21ssh22:26:490
3339953424,464cyclictest24669-21ssh22:26:490
3359953266,84cyclictest0-21swapper/222:25:262
3359953266,84cyclictest0-21swapper/222:25:262
3349953223,507cyclictest0-21swapper/123:39:411
34099529444,3cyclictest711rcuc/722:08:327
3399952413,337cyclictest0-21swapper/600:37:426
3339952415,84cyclictest0-21swapper/000:39:290
335995209,508cyclictest0-21swapper/221:51:582
3359951913,295cyclictest0-21swapper/223:18:142
33499518263,253cyclictest241ktimersoftd/122:10:191
33599512168,127cyclictest33-21ksoftirqd/221:14:362
334995126,422cyclictest0-21swapper/122:30:281
334995090,42cyclictest0-21swapper/100:09:441
333995090,42cyclictest0-21swapper/022:56:290
339995081,210cyclictest0-21swapper/621:54:256
3359950539,463cyclictest0-21swapper/221:16:452
334995050,3cyclictest0-21swapper/122:25:371
334995050,3cyclictest0-21swapper/122:25:361
33999504164,338cyclictest0-21swapper/622:51:026
3359950435,338cyclictest0-21swapper/223:38:312
33899502207,259cyclictest561ktimersoftd/521:54:255
3409949971,211cyclictest73-21ksoftirqd/722:50:347
3369949934,126cyclictest0-21swapper/300:10:513
3369949934,126cyclictest0-21swapper/300:10:513
3389949876,84cyclictest0-21swapper/520:52:305
3389949775,256cyclictest24410-21gltestperf23:20:215
3369949729,296cyclictest0-21swapper/323:14:443
33699495115,296cyclictest0-21swapper/320:52:303
3359949527,169cyclictest0-21swapper/220:52:442
3349949526,254cyclictest0-21swapper/120:53:111
3339949524,467cyclictest0-21swapper/000:14:360
3339949524,467cyclictest0-21swapper/000:14:360
3399949472,256cyclictest330-21cyclictest23:17:346
33699494110,127cyclictest41-21ksoftirqd/323:15:573
3349949430,385cyclictest0-21swapper/100:38:511
33899492450,40cyclictest551rcuc/521:19:005
3369949269,85cyclictest0-21swapper/322:30:123
33699492408,4cyclictest391rcuc/321:15:343
3359949265,211cyclictest0-21swapper/223:27:262
3399949027,331cyclictest0-21swapper/622:26:316
3399949027,331cyclictest0-21swapper/622:26:316
3339948922,464cyclictest0-21swapper/000:27:190
3389948823,210cyclictest0-21swapper/500:10:275
3389948823,210cyclictest0-21swapper/500:10:275
3389948760,211cyclictest57-21ksoftirqd/522:30:255
33899487444,41cyclictest551rcuc/522:08:325
3379948720,211cyclictest49-21ksoftirqd/421:54:104
3379948718,126cyclictest0-21swapper/421:16:204
3399948659,211cyclictest0-21swapper/600:00:116
34099485232,42cyclictest30186-21nscd22:29:117
34099485232,42cyclictest30186-21nscd22:29:117
3399948563,84cyclictest0-21swapper/620:52:316
3369948514,211cyclictest0-21swapper/323:28:383
3389948417,338cyclictest0-21swapper/522:25:595
3389948417,338cyclictest0-21swapper/522:25:585
3349948418,126cyclictest25-21ksoftirqd/123:14:341
3399948318,301cyclictest0-21swapper/623:27:406
3349948116,296cyclictest23656-21python00:30:251
33799480140,337cyclictest9843-21cron19:25:014
33699480225,84cyclictest401ktimersoftd/300:15:233
3369948013,84cyclictest0-21swapper/300:28:263
3359948012,465cyclictest0-21swapper/222:10:192
3409947999,84cyclictest0-21swapper/700:28:197
3399947898,256cyclictest0-21swapper/623:20:186
3399947897,85cyclictest25982-21latency_hist23:40:056
33999477136,338cyclictest28174-1kworker/u17:023:59:556
3399947712,249cyclictest0-21swapper/600:12:336
3399947712,249cyclictest0-21swapper/600:12:326
34099475138,254cyclictest721ktimersoftd/700:08:307
339994759,211cyclictest0-21swapper/622:30:316
3409947493,83cyclictest0-21swapper/720:54:007
3369947149,84cyclictest0-21swapper/322:24:343
3369947149,81cyclictest0-21swapper/322:26:263
3369947149,81cyclictest0-21swapper/322:26:263
3409946947,257cyclictest330-21cyclictest23:17:417
340994693,211cyclictest0-21swapper/721:55:257
340994693,211cyclictest0-21swapper/721:55:257
34099468212,126cyclictest20470-21ssh21:16:107
3379946884,211cyclictest0-21swapper/422:29:264
3379946884,211cyclictest0-21swapper/422:29:264
3379946844,84cyclictest0-21swapper/400:28:484
3379946788,85cyclictest0-21swapper/423:39:004
33599467125,339cyclictest0-21swapper/221:55:202
33599467125,339cyclictest0-21swapper/221:55:192
34099466124,339cyclictest0-21swapper/723:29:267
3389946681,211cyclictest15711-21runrttasks21:13:425
3389946640,210cyclictest57-21ksoftirqd/500:21:405
33599466125,338cyclictest0-21swapper/200:30:252
333994660,41cyclictest0-21swapper/019:54:040
3389946580,126cyclictest57-21ksoftirqd/523:17:425
3379946582,83cyclictest0-21swapper/421:55:124
3379946582,83cyclictest0-21swapper/421:55:124
33699465124,338cyclictest0-21swapper/300:38:203
33699465124,338cyclictest0-21swapper/300:06:513
34099464124,337cyclictest0-21swapper/719:55:167
34099464124,304cyclictest0-21swapper/722:30:277
33999464120,169cyclictest641ktimersoftd/622:10:266
3379946485,84cyclictest0-21swapper/422:09:514
3409946382,84cyclictest0-21swapper/719:52:557
34099463122,338cyclictest0-21swapper/723:59:457
34099463122,338cyclictest0-21swapper/723:37:117
3369946277,126cyclictest121rcu_preempt21:12:353
33699462120,339cyclictest0-21swapper/322:55:363
3359946235,296cyclictest0-21swapper/222:24:112
3349946240,343cyclictest0-21swapper/100:15:221
334994621,119cyclictest241ktimersoftd/123:40:101
3409946139,257cyclictest0-21swapper/723:20:207
34099461118,340cyclictest8156-21sh00:21:367
33399461120,84cyclictest22767-21hddtemp_smartct00:30:170
34099460119,338cyclictest0-21swapper/700:36:557
3359946033,177cyclictest0-21swapper/222:56:002
33599460119,339cyclictest0-21swapper/219:54:392
3369945936,256cyclictest0-21swapper/323:20:213
33699459118,338cyclictest0-21swapper/321:55:333
33699459118,338cyclictest0-21swapper/321:55:333
33699459118,338cyclictest0-21swapper/319:53:273
3359945932,261cyclictest0-21swapper/200:00:252
3409945879,84cyclictest0-21swapper/722:24:337
33699458118,338cyclictest0-21swapper/300:21:473
33599458119,84cyclictest0-21swapper/200:26:552
3359945734,256cyclictest0-21swapper/223:14:352
33599457117,84cyclictest0-21swapper/220:55:192
34099456115,338cyclictest0-21swapper/722:56:297
3399945634,255cyclictest0-21swapper/621:17:466
3379945675,84cyclictest26322-21/usr/sbin/munin23:40:114
33799456115,338cyclictest0-21swapper/423:16:094
33799456114,50cyclictest121rcu_preempt20:53:594
33699456115,338cyclictest0-21swapper/319:23:593
33599456116,84cyclictest0-21swapper/223:30:062
33699455115,338cyclictest0-21swapper/322:10:083
33699455113,85cyclictest23353-21ssh23:37:103
34099454371,3cyclictest711rcuc/720:55:187
33999454116,171cyclictest0-21swapper/622:55:306
3359945431,256cyclictest0-21swapper/222:49:562
33999453111,211cyclictest0-21swapper/600:30:206
33799453112,129cyclictest0-21swapper/421:14:574
3359945326,296cyclictest1551-21snmpd22:30:332
34099452111,338cyclictest0-21swapper/719:25:137
33999452115,171cyclictest0-21swapper/622:09:386
3389945226,338cyclictest0-21swapper/522:55:515
33899452115,253cyclictest0-21swapper/500:09:495
3339945232,36cyclictest0-21swapper/000:15:150
33799451110,338cyclictest0-21swapper/423:28:404
33399451111,338cyclictest698-21ptp4l00:21:370
34099450109,338cyclictest0-21swapper/700:15:227
33499450110,338cyclictest0-21swapper/100:26:451
34099448107,338cyclictest0-21swapper/723:40:117
3399944825,260cyclictest0-21swapper/600:27:196
33999448109,84cyclictest0-21swapper/621:55:346
33999448109,84cyclictest0-21swapper/621:55:346
3379944868,84cyclictest0-21swapper/422:24:354
33999445106,84cyclictest0-21swapper/620:55:206
33799445106,336cyclictest0-21swapper/422:49:574
3339944559,169cyclictest9-21ksoftirqd/021:20:080
33999444105,84cyclictest0-21swapper/623:30:066
3389944422,4cyclictest5842-21ssh23:27:385
3409944362,85cyclictest0-21swapper/721:14:087
3389944220,253cyclictest0-21swapper/523:38:265
33799442143,126cyclictest121rcu_preempt22:55:134
3409944114,254cyclictest24571-21ssh22:10:147
3399944119,2cyclictest0-21swapper/600:07:556
3359944119,212cyclictest0-21swapper/219:25:022
3359944118,213cyclictest0-21swapper/200:15:252
3349944119,257cyclictest20378-21ssh22:24:521
3339944114,253cyclictest0-21swapper/023:40:180
3389944099,210cyclictest18027-21taskset00:26:405
3379944018,50cyclictest0-21swapper/419:55:174
3399943716,49cyclictest0-21swapper/619:55:186
3379943655,84cyclictest0-21swapper/419:54:384
3389943411,169cyclictest0-21swapper/500:39:465
33799434179,253cyclictest481ktimersoftd/422:30:314
3389943311,126cyclictest0-21swapper/523:59:545
3409943296,81cyclictest0-21swapper/722:49:567
3409943293,84cyclictest0-21swapper/723:14:367
338994328,211cyclictest0-21swapper/500:00:115
3399943095,80cyclictest0-21swapper/619:53:266
33999430172,211cyclictest121rcu_preempt22:24:246
333994291,211cyclictest0-21swapper/022:30:190
3409942745,84cyclictest0-21swapper/700:00:247
3369942746,84cyclictest23221-21sh22:09:493
3359942645,84cyclictest0-21swapper/200:21:402
3389942482,211cyclictest0-21swapper/522:10:295
338994241,168cyclictest0-21swapper/523:14:435
3339942382,338cyclictest0-21swapper/020:55:150
3409942181,84cyclictest0-21swapper/723:30:077
3399942182,84cyclictest0-21swapper/622:49:466
3379942182,84cyclictest0-21swapper/400:15:274
3349942179,211cyclictest0-21swapper/119:55:081
3349942141,256cyclictest0-21swapper/120:55:141
3399942081,84cyclictest0-21swapper/600:15:166
3369942080,85cyclictest0-21swapper/322:49:563
3349942080,338cyclictest0-21swapper/119:25:121
3389941980,84cyclictest0-21swapper/519:23:485
3369941978,338cyclictest0-21swapper/323:30:073
3359941940,257cyclictest0-21swapper/223:40:172
3339941978,338cyclictest0-21swapper/000:00:110
3379941879,84cyclictest0-21swapper/423:59:444
3349941878,338cyclictest0-21swapper/100:21:401
33799417203,212cyclictest481ktimersoftd/400:30:174
3359941777,338cyclictest0-21swapper/219:25:112
3349941776,338cyclictest0-21swapper/121:20:151
3409941677,84cyclictest0-21swapper/700:30:167
3389941678,84cyclictest0-21swapper/500:15:165
3339941676,338cyclictest0-21swapper/019:25:110
3359941575,338cyclictest0-21swapper/223:59:542
3379941478,83cyclictest0-21swapper/423:14:374
3379941478,83cyclictest0-21swapper/422:10:244
3339941473,338cyclictest0-21swapper/023:59:450
3369941374,84cyclictest782-21head20:55:143
3399941274,84cyclictest0-21swapper/619:24:006
3399941270,126cyclictest65-21ksoftirqd/600:21:416
3389941172,84cyclictest0-21swapper/522:24:105
3369941172,84cyclictest0-21swapper/319:55:143
3389941068,211cyclictest8389-21diskmemload00:30:275
33899409111,126cyclictest26321-21ssh23:40:095
3389940869,84cyclictest0-21swapper/519:25:145
3379940870,83cyclictest0-21swapper/420:55:214
3369940666,84cyclictest0-21swapper/300:30:173
3339940627,211cyclictest0-21swapper/023:30:090
33999405194,130cyclictest330-21cyclictest23:40:096
3349940565,338cyclictest0-21swapper/123:59:441
3389940323,170cyclictest0-21swapper/521:55:255
3389940323,170cyclictest0-21swapper/521:55:245
3379940365,83cyclictest0-21swapper/419:25:144
3339940363,338cyclictest0-21swapper/022:49:570
3359940262,338cyclictest0-21swapper/221:20:112
3369940162,84cyclictest0-21swapper/323:40:093
3389940064,83cyclictest561ktimersoftd/519:54:355
3389939960,84cyclictest0-21swapper/520:55:055
3409939898,126cyclictest0-21swapper/719:22:537
3389939860,84cyclictest0-21swapper/519:55:155
3379939759,84cyclictest0-21swapper/400:21:354
3359939759,83cyclictest0-21swapper/219:55:162
3409939512,252cyclictest694-21irqbalance21:20:087
3389939556,84cyclictest0-21swapper/521:20:135
3379938445,84cyclictest0-21swapper/421:20:144
33799384174,130cyclictest3246-21rm00:00:174
3369938347,81cyclictest0-21swapper/300:00:183
3339937734,211cyclictest0-21swapper/019:55:070
33699376119,254cyclictest8297-21kworker/u16:021:20:153
3399937334,84cyclictest0-21swapper/619:25:126
33899370118,86cyclictest0-21swapper/522:49:585
3349937032,177cyclictest0-21swapper/122:49:561
3399936527,171cyclictest0-21swapper/621:20:126
33699364108,254cyclictest0-21swapper/319:25:143
3399935922,172cyclictest0-21swapper/623:14:356
3379934185,253cyclictest64450irq/122-eth023:30:104
3369932732,169cyclictest0-21swapper/323:59:543
3389932631,211cyclictest0-21swapper/523:30:085
3349932529,212cyclictest0-21swapper/123:30:071
361821100,0sleep60-21swapper/622:15:236
3213529046,8sleep50-21swapper/519:06:435
3209728452,28sleep30-21swapper/319:06:093
3220828352,28sleep10-21swapper/119:07:421
3206728351,28sleep20-21swapper/219:05:432
3212128252,27sleep00-21swapper/019:06:290
3211828048,28sleep60-21swapper/619:06:276
3210728048,28sleep40-21swapper/419:06:184
310682790,0sleep60-21swapper/623:05:226
2976927949,27sleep70-21swapper/719:05:087
134572760,1sleep40-21swapper/422:39:214
198652750,1sleep40-21swapper/423:00:164
52152730,1sleep45219-21hwlatdetect23:45:174
204922720,0sleep40-21swapper/421:34:094
140052710,1sleep20-21swapper/222:39:422
291732690,0sleep10-21swapper/121:38:071
17262610,0sleep20-21swapper/219:10:162
122372560,0sleep10-21swapper/121:45:191
335993110,21cyclictest0-21swapper/220:41:252
335993025,4cyclictest0-21swapper/221:35:522
340992910,18cyclictest0-21swapper/720:15:137
335992928,0cyclictest0-21swapper/219:35:372
335992928,0cyclictest0-21swapper/219:35:362
335992926,2cyclictest0-21swapper/219:19:482
340992827,0cyclictest0-21swapper/721:09:447
340992810,18cyclictest0-21swapper/721:35:447
340992810,0cyclictest0-21swapper/719:14:157
339992810,17cyclictest0-21swapper/620:22:576
339992810,0cyclictest0-21swapper/620:33:156
338992810,18cyclictest0-21swapper/520:33:075
337992810,0cyclictest0-21swapper/419:14:174
336992810,18cyclictest0-21swapper/321:35:443
336992810,18cyclictest0-21swapper/320:41:593
336992810,18cyclictest0-21swapper/319:14:153
335992827,1cyclictest0-21swapper/220:15:132
335992810,1cyclictest0-21swapper/220:14:412
335992810,17cyclictest0-21swapper/220:32:592
334992810,0cyclictest0-21swapper/120:41:491
333992810,18cyclictest0-21swapper/021:36:050
340992727,0cyclictest0-21swapper/720:06:557
340992710,17cyclictest0-21swapper/720:41:287
340992710,17cyclictest0-21swapper/719:42:537
340992710,0cyclictest0-21swapper/720:33:217
340992710,0cyclictest0-21swapper/720:22:557
340992710,0cyclictest0-21swapper/719:36:227
340992710,0cyclictest0-21swapper/719:36:227
339992722,1cyclictest121rcu_preempt19:35:376
339992722,1cyclictest121rcu_preempt19:35:366
339992710,17cyclictest0-21swapper/621:35:406
339992710,17cyclictest0-21swapper/620:41:546
339992710,17cyclictest0-21swapper/620:15:156
339992710,17cyclictest0-21swapper/619:50:006
339992710,17cyclictest0-21swapper/619:19:416
339992710,0cyclictest0-21swapper/619:42:496
339992710,0cyclictest0-21swapper/619:14:116
338992727,0cyclictest0-21swapper/519:35:485
338992727,0cyclictest0-21swapper/519:35:475
338992726,1cyclictest0-21swapper/520:06:565
338992710,17cyclictest0-21swapper/521:35:275
338992710,17cyclictest0-21swapper/521:09:155
338992710,17cyclictest0-21swapper/520:41:325
338992710,17cyclictest0-21swapper/519:49:565
338992710,17cyclictest0-21swapper/519:42:535
338992710,16cyclictest0-21swapper/520:15:035
338992710,0cyclictest0-21swapper/520:22:575
338992710,0cyclictest0-21swapper/519:19:375
337992710,17cyclictest0-21swapper/421:35:324
337992710,17cyclictest0-21swapper/420:41:264
337992710,17cyclictest0-21swapper/420:22:524
337992710,17cyclictest0-21swapper/420:15:154
337992710,17cyclictest0-21swapper/419:50:014
337992710,17cyclictest0-21swapper/419:42:514
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional