You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-06 - 03:38
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Wed May 06, 2026 00:55:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
205659978765,84cyclictest0-21swapper/623:48:266
205659978722,127cyclictest0-21swapper/623:50:086
205669971983,126cyclictest0-21swapper/723:19:427
2056099704193,211cyclictest21334-21latency_hist23:10:051
205659966569,211cyclictest0-21swapper/622:45:506
205659964954,84cyclictest9844-21ssh23:21:536
205609962735,126cyclictest0-21swapper/121:29:371
2056099616105,338cyclictest0-21swapper/122:44:351
2056399615107,88cyclictest0-21swapper/421:28:384
205659961422,508cyclictest0-21swapper/621:27:316
205659961316,472cyclictest0-21swapper/623:30:516
2056699612101,380cyclictest0-21swapper/723:59:127
2056199612354,127cyclictest0-21swapper/200:21:342
205599960915,84cyclictest0-21swapper/023:59:180
20563995930,84cyclictest0-21swapper/400:20:064
205629959382,296cyclictest26256-21sleep21:29:563
20561995930,84cyclictest0-21swapper/200:20:052
20559995911,83cyclictest0-21swapper/022:04:280
205649958941,84cyclictest0-21swapper/522:34:165
205609958981,126cyclictest0-21swapper/123:57:101
205659958734,84cyclictest0-21swapper/622:11:326
205639958636,126cyclictest0-21swapper/400:42:264
205609958678,126cyclictest0-21swapper/122:49:561
2056099584120,253cyclictest0-21swapper/119:17:491
205659958375,505cyclictest27458-21runrttasks00:42:416
2056399583500,4cyclictest481ktimersoftd/422:49:574
205609958133,2cyclictest0-21swapper/122:31:591
2056099576107,296cyclictest0-21swapper/122:50:121
205659957565,507cyclictest0-21swapper/622:50:066
2056399575107,126cyclictest0-21swapper/421:03:194
2056099575365,43cyclictest0-21swapper/122:15:511
2055999575276,84cyclictest0-21swapper/023:49:440
2056699574109,85cyclictest0-21swapper/721:30:187
205619956898,254cyclictest121rcu_preempt23:58:352
2056199568269,211cyclictest0-21swapper/222:29:382
205639956658,211cyclictest121rcu_preempt22:11:284
205609956697,295cyclictest0-21swapper/122:13:261
205619956515,84cyclictest121rcu_preempt22:03:242
205639956495,334cyclictest20557-21cyclictest00:33:434
205609956415,126cyclictest0-21swapper/121:30:171
2056599563480,4cyclictest631rcuc/600:18:006
205649956350,126cyclictest0-21swapper/523:50:145
205619956212,84cyclictest0-21swapper/223:48:432
20560995618,296cyclictest27542-21ssh00:42:511
205599956010,84cyclictest0-21swapper/022:32:380
205609955890,295cyclictest0-21swapper/100:16:121
2055999557184,205cyclictest121rcu_preempt23:09:580
205599955645,338cyclictest23418-21munin-node23:17:190
205669955383,296cyclictest0-21swapper/722:45:317
2056699553213,338cyclictest19506-1kworker/u17:023:49:147
20564995532,127cyclictest0-21swapper/522:49:035
205599955343,83cyclictest0-21swapper/023:20:500
205599955244,126cyclictest0-21swapper/022:12:290
2056299551294,126cyclictest0-21swapper/323:19:413
2055999551294,84cyclictest0-21swapper/022:49:500
205659954882,169cyclictest0-21swapper/600:34:186
2056499547249,85cyclictest0-21swapper/523:09:235
205639954782,211cyclictest187-21md0_raid122:30:364
205619954537,126cyclictest33-21ksoftirqd/222:49:462
205599954538,42cyclictest121rcu_preempt00:22:170
205669954437,423cyclictest15850irq/123-ahci[0023:27:037
205659954333,84cyclictest0-21swapper/622:44:476
2056499543244,126cyclictest6640-1kworker/u17:223:59:485
205639954375,295cyclictest0-21swapper/422:03:234
205619954334,126cyclictest0-21swapper/222:56:472
205669954235,296cyclictest0-21swapper/722:56:417
205669954234,126cyclictest0-21swapper/722:29:397
205609954234,126cyclictest121rcu_preempt00:00:231
205629954172,296cyclictest0-21swapper/322:14:123
2056099541115,253cyclictest0-21swapper/123:16:581
205599954173,465cyclictest0-21swapper/000:00:090
205659953928,508cyclictest0-21swapper/623:58:136
205629953872,126cyclictest0-21swapper/323:07:493
205599953872,211cyclictest0-21swapper/000:18:050
2056699537197,338cyclictest28152-21diskmemload00:32:317
205669953578,296cyclictest28152-21diskmemload22:42:267
205639953524,380cyclictest0-21swapper/423:10:134
205639953524,253cyclictest0-21swapper/423:59:284
205619953468,211cyclictest0-21swapper/221:29:382
205599953427,84cyclictest0-21swapper/023:10:130
205639953327,84cyclictest121rcu_preempt23:08:384
2056199532118,330cyclictest0-21swapper/221:30:172
205599953222,211cyclictest0-21swapper/000:35:220
2056099530103,211cyclictest25-21ksoftirqd/123:49:401
205599953019,295cyclictest0-21swapper/000:43:020
205669952922,423cyclictest0-21swapper/719:20:207
2056599529188,338cyclictest704-21nscd22:31:186
205599952918,84cyclictest0-21swapper/019:18:140
205649952819,84cyclictest0-21swapper/523:16:515
2056699527187,338cyclictest26202-21nscd23:20:557
205619952718,127cyclictest0-21swapper/222:12:232
2056299526482,42cyclictest391rcuc/323:48:253
205629952618,42cyclictest0-21swapper/322:47:063
205639952413,42cyclictest0-21swapper/422:42:164
205669952396,296cyclictest121rcu_preempt23:31:537
205649952313,344cyclictest17259-21sh22:50:095
205609951911,169cyclictest0-21swapper/123:20:401
20565995154,84cyclictest0-21swapper/622:15:346
205649951390,296cyclictest0-21swapper/522:16:435
2056099513215,126cyclictest0-21swapper/122:56:511
205659951083,254cyclictest0-21swapper/622:04:486
20559995103,8cyclictest0-21swapper/022:35:180
20559995103,8cyclictest0-21swapper/022:35:180
2056699509424,3cyclictest721ktimersoftd/722:33:267
20566995090,42cyclictest0-21swapper/722:15:257
20565995090,84cyclictest0-21swapper/621:04:416
205649950986,84cyclictest21698-21ssh23:10:105
20564995090,84cyclictest0-21swapper/522:04:345
20561995081,85cyclictest121rcu_preempt23:08:562
205599950780,211cyclictest0-21swapper/022:41:510
205629950576,296cyclictest0-21swapper/300:20:243
2055999505162,297cyclictest0-21swapper/022:50:230
205629950435,218cyclictest121rcu_preempt22:29:303
205599950439,42cyclictest121rcu_preempt21:29:350
2056699503419,3cyclictest721ktimersoftd/722:11:097
2056499503123,169cyclictest8178-21ssh22:41:415
205619950381,338cyclictest0-21swapper/222:33:032
205649950276,296cyclictest0-21swapper/523:50:005
205619950275,210cyclictest0-21swapper/200:43:452
205609950234,126cyclictest0-21swapper/100:20:181
205649950074,338cyclictest121rcu_preempt22:11:105
205659949931,465cyclictest0-21swapper/623:19:586
2056299498198,126cyclictest17563-1kworker/u17:200:34:183
205609949875,380cyclictest0-21swapper/122:28:001
205639949631,84cyclictest121rcu_preempt22:28:254
2056199496117,295cyclictest20557-21cyclictest22:44:452
205599949632,84cyclictest3228-21df_abs21:30:170
205619949468,296cyclictest0-21swapper/222:15:532
205669949369,84cyclictest0-21swapper/721:30:037
205669949328,42cyclictest0-21swapper/723:09:467
205639949272,337cyclictest0-21swapper/421:30:184
205629949121,295cyclictest0-21swapper/322:44:253
205599949026,84cyclictest0-21swapper/022:15:160
205629948823,84cyclictest0-21swapper/300:41:303
205619948761,127cyclictest9320-21ssh00:31:382
205639948617,84cyclictest121rcu_preempt22:50:204
205629948663,339cyclictest0-21swapper/322:33:043
205649948458,295cyclictest0-21swapper/500:19:555
205649948418,126cyclictest0-21swapper/521:02:565
205659948314,466cyclictest0-21swapper/622:29:246
205639948319,258cyclictest0-21swapper/419:18:364
2056299483184,126cyclictest121rcu_preempt22:56:503
205599948317,84cyclictest0-21swapper/022:28:000
205629948259,211cyclictest0-21swapper/322:04:043
205659948115,211cyclictest0-21swapper/623:09:206
2056399481142,337cyclictest64450irq/122-eth000:20:504
205639947916,42cyclictest0-21swapper/400:00:204
205639947915,295cyclictest0-21swapper/423:26:584
205609947915,84cyclictest0-21swapper/100:35:141
205619947751,338cyclictest0-21swapper/223:17:302
20565994757,126cyclictest0-21swapper/600:12:086
205609947510,295cyclictest0-21swapper/122:03:371
205629947410,126cyclictest18431-21smartctl22:50:213
20564994739,42cyclictest0-21swapper/521:28:455
20559994737,126cyclictest0-21swapper/000:33:340
20566994726,84cyclictest0-21swapper/700:42:077
2056299472182,203cyclictest704-21nscd22:15:533
20562994712,296cyclictest0-21swapper/323:21:303
2055999471127,296cyclictest0-21swapper/023:31:210
205639947086,169cyclictest49-21ksoftirqd/423:18:314
20560994702,295cyclictest25-21ksoftirqd/119:20:161
20559994671,42cyclictest0-21swapper/021:05:040
20566994660,41cyclictest0-21swapper/721:03:577
2056499466125,338cyclictest0-21swapper/519:20:055
2056399466125,126cyclictest8398-21rm23:20:334
20564994651,42cyclictest0-21swapper/500:32:025
2056399465124,338cyclictest0-21swapper/422:16:264
20560994651,84cyclictest0-21swapper/123:50:061
2056699464123,338cyclictest0-21swapper/700:00:227
205639946483,126cyclictest121rcu_preempt22:05:034
205639946339,337cyclictest0-21swapper/400:35:204
205619946379,169cyclictest33-21ksoftirqd/223:21:272
205669946277,211cyclictest27021-21cron19:20:037
2056699462163,126cyclictest121rcu_preempt00:15:497
205659946137,3cyclictest0-21swapper/623:26:176
2056699460118,126cyclictest73-21ksoftirqd/722:05:077
205659946042,415cyclictest0-21swapper/600:22:146
205629946037,2cyclictest0-21swapper/321:05:043
205629945931,296cyclictest0-21swapper/323:57:103
205609945975,211cyclictest0-21swapper/100:31:501
205649945835,126cyclictest0-21swapper/521:30:235
205649945734,257cyclictest0-21swapper/523:21:345
205639945735,342cyclictest0-21swapper/423:30:474
205629945734,177cyclictest0-21swapper/300:00:153
2056199457117,338cyclictest27355-21df_abs22:35:172
2056199457117,338cyclictest27355-21df_abs22:35:172
205629945634,84cyclictest0-21swapper/321:30:183
205629945634,2cyclictest0-21swapper/323:26:183
205669945533,2cyclictest0-21swapper/722:04:317
205659945530,422cyclictest0-21swapper/622:35:126
205659945530,422cyclictest0-21swapper/622:35:126
205609945534,3cyclictest121rcu_preempt21:03:561
2056499454114,337cyclictest0-21swapper/500:43:205
205629945230,2cyclictest0-21swapper/319:20:063
205659945126,422cyclictest0-21swapper/622:05:066
2056199451111,338cyclictest18882-21ssh22:50:302
205649945029,255cyclictest0-21swapper/522:27:555
205619944927,253cyclictest0-21swapper/200:35:172
2055999449109,338cyclictest0-21swapper/023:27:120
2056699448107,338cyclictest22058-21nscd22:50:297
2056199448107,126cyclictest27057-21readlink19:20:012
2056199447107,338cyclictest0-21swapper/223:26:502
205639944662,126cyclictest0-21swapper/423:49:534
2056199445104,338cyclictest0-21swapper/222:05:102
2056499444232,210cyclictest12664-21apt00:35:125
205609944216,254cyclictest0-21swapper/123:26:591
2056599441102,84cyclictest0-21swapper/621:30:126
205629944161,84cyclictest0-21swapper/300:20:043
205619944157,169cyclictest0-21swapper/223:31:302
2056199441143,126cyclictest121rcu_preempt00:00:132
2056099441230,127cyclictest28152-21diskmemload22:05:121
205649944019,379cyclictest0-21swapper/519:20:145
205599944018,254cyclictest0-21swapper/022:05:110
205649943998,338cyclictest0-21swapper/522:56:485
205629943916,126cyclictest0-21swapper/322:35:253
205629943916,126cyclictest0-21swapper/322:35:253
205649943814,85cyclictest0-21swapper/523:27:025
205599943815,84cyclictest0-21swapper/022:56:500
205669943458,292cyclictest0-21swapper/700:21:037
2055999427170,84cyclictest121rcu_preempt19:20:160
20564994253,83cyclictest121rcu_preempt23:31:375
20562994242,2cyclictest0-21swapper/323:31:133
2056299423213,85cyclictest0-21swapper/323:10:133
205669942241,296cyclictest0-21swapper/723:10:147
205639942283,337cyclictest0-21swapper/423:50:044
205669942141,296cyclictest0-21swapper/700:35:157
205649942041,295cyclictest0-21swapper/522:35:155
205649942041,295cyclictest0-21swapper/522:35:155
205639942076,211cyclictest49-21ksoftirqd/422:56:354
205649941979,210cyclictest561ktimersoftd/500:20:545
205669941876,339cyclictest0-21swapper/723:50:077
205669941838,296cyclictest0-21swapper/722:35:327
205669941838,296cyclictest0-21swapper/722:35:317
205639941878,337cyclictest0-21swapper/422:35:084
205639941878,337cyclictest0-21swapper/422:35:084
2056299418160,126cyclictest16949-21kworker/u16:000:35:163
2056299418126,119cyclictest41-21ksoftirqd/323:50:133
205619941877,338cyclictest0-21swapper/223:50:152
205649941737,85cyclictest15199-21tail00:00:245
2056499417115,299cyclictest0-21swapper/500:12:095
205619941776,338cyclictest0-21swapper/219:20:182
205659941578,253cyclictest13530-21fschecks_count00:35:226
205659941576,84cyclictest0-21swapper/600:00:086
2056099415241,84cyclictest0-21swapper/123:31:451
205619941472,127cyclictest33-21ksoftirqd/223:10:142
205629941374,84cyclictest0-21swapper/322:05:073
205609941371,127cyclictest0-21swapper/123:10:101
205599941069,338cyclictest29254-21diskmemload23:50:070
205659940926,380cyclictest0-21swapper/621:05:126
205659940925,381cyclictest0-21swapper/619:19:316
205659940723,381cyclictest0-21swapper/622:56:046
205609940627,214cyclictest0-21swapper/122:35:181
205609940627,214cyclictest0-21swapper/122:35:181
205659940465,84cyclictest0-21swapper/619:20:186
205659939961,83cyclictest0-21swapper/623:10:156
205649939617,7cyclictest121rcu_preempt22:05:135
205609939695,298cyclictest0-21swapper/100:12:091
205629939511,169cyclictest0-21swapper/319:20:193
205619939111,126cyclictest0-21swapper/221:05:052
205629939051,169cyclictest0-21swapper/300:12:063
205629938547,42cyclictest0-21swapper/321:05:113
205599937978,168cyclictest9-21ksoftirqd/000:12:080
205639937736,338cyclictest0-21swapper/419:20:154
205669937436,171cyclictest0-21swapper/721:05:067
205649937436,3cyclictest0-21swapper/521:05:095
205639937337,170cyclictest0-21swapper/421:05:064
205639937332,338cyclictest64450irq/122-eth000:12:154
205609936166,211cyclictest0-21swapper/121:05:131
205669935719,42cyclictest0-21swapper/700:12:157
205619933581,84cyclictest20557-21cyclictest00:11:462
205649933034,3cyclictest0-21swapper/500:25:365
205639932729,295cyclictest0-21swapper/400:25:364
2056199326116,84cyclictest0-21swapper/221:05:122
205669931217,211cyclictest15850irq/123-ahci[0000:25:367
205599930650,129cyclictest0-21swapper/021:05:060
205609928734,7cyclictest0-21swapper/100:25:361
205659927825,168cyclictest0-21swapper/600:25:376
205599925440,211cyclictest0-21swapper/000:25:360
205619925178,84cyclictest121rcu_preempt00:25:372
205629923217,126cyclictest0-21swapper/300:25:363
17966210095,2sleep50-21swapper/519:05:195
17531210088,8sleep30-21swapper/319:05:083
2005628654,28sleep10-21swapper/119:08:591
2004728554,28sleep20-21swapper/219:08:522
1991928452,28sleep60-21swapper/619:07:046
1984528454,27sleep70-21swapper/719:06:017
1986027847,28sleep40-21swapper/419:06:154
1983627848,27sleep00-21swapper/019:05:540
130692730,0sleep20-21swapper/221:18:022
20563992910,18cyclictest0-21swapper/420:02:584
20566992810,18cyclictest0-21swapper/721:54:207
20566992810,18cyclictest0-21swapper/720:46:297
20566992810,0cyclictest0-21swapper/720:24:067
20564992827,1cyclictest0-21swapper/519:53:415
20564992810,17cyclictest0-21swapper/520:02:225
20562992828,0cyclictest0-21swapper/321:54:033
20562992810,18cyclictest0-21swapper/320:23:503
20562992810,0cyclictest0-21swapper/320:36:253
20561992828,0cyclictest0-21swapper/220:35:512
20561992810,17cyclictest0-21swapper/219:53:452
20560992810,18cyclictest0-21swapper/119:14:021
20560992810,17cyclictest0-21swapper/121:54:151
20566992727,0cyclictest0-21swapper/720:13:167
20566992727,0cyclictest0-21swapper/720:02:527
20566992727,0cyclictest0-21swapper/719:33:027
20566992710,17cyclictest0-21swapper/720:35:527
20566992710,17cyclictest0-21swapper/719:43:337
20566992710,17cyclictest0-21swapper/719:13:487
20566992710,0cyclictest0-21swapper/719:53:397
20565992727,0cyclictest0-21swapper/620:36:036
20565992710,17cyclictest0-21swapper/621:53:456
20565992710,17cyclictest0-21swapper/620:59:536
20565992710,17cyclictest0-21swapper/620:46:516
20565992710,17cyclictest0-21swapper/620:13:176
20565992710,0cyclictest0-21swapper/620:02:296
20565992710,0cyclictest0-21swapper/619:53:126
20565992710,0cyclictest0-21swapper/619:43:316
20565992710,0cyclictest0-21swapper/619:32:566
20564992726,1cyclictest0-21swapper/521:53:535
20564992726,0cyclictest0-21swapper/519:13:355
20564992710,17cyclictest0-21swapper/520:59:565
20564992710,17cyclictest0-21swapper/519:43:315
20564992710,17cyclictest0-21swapper/519:32:575
20564992710,0cyclictest0-21swapper/520:46:305
20564992710,0cyclictest0-21swapper/520:36:055
20564992710,0cyclictest0-21swapper/520:23:375
20564992710,0cyclictest0-21swapper/520:13:405
20563992727,0cyclictest0-21swapper/420:13:494
20563992727,0cyclictest0-21swapper/419:43:314
20563992727,0cyclictest0-21swapper/419:32:594
20563992727,0cyclictest0-21swapper/419:13:364
20563992710,17cyclictest0-21swapper/421:53:444
20563992710,17cyclictest0-21swapper/420:23:424
20563992710,17cyclictest0-21swapper/419:53:184
20563992710,0cyclictest0-21swapper/420:59:584
20563992710,0cyclictest0-21swapper/420:46:414
20563992710,0cyclictest0-21swapper/420:35:514
20562992727,0cyclictest0-21swapper/319:14:013
20562992710,17cyclictest0-21swapper/320:59:523
20562992710,17cyclictest0-21swapper/320:46:353
20562992710,17cyclictest0-21swapper/320:13:283
20562992710,17cyclictest0-21swapper/320:02:313
20562992710,17cyclictest0-21swapper/319:43:533
20562992710,0cyclictest0-21swapper/319:53:203
20562992710,0cyclictest0-21swapper/319:32:573
20561992710,17cyclictest0-21swapper/221:53:452
20561992710,17cyclictest0-21swapper/220:46:272
20561992710,17cyclictest0-21swapper/220:23:432
20561992710,17cyclictest0-21swapper/220:13:362
20561992710,17cyclictest0-21swapper/220:02:492
20561992710,17cyclictest0-21swapper/219:43:292
20561992710,17cyclictest0-21swapper/219:13:442
20561992710,0cyclictest0-21swapper/219:32:552
20560992710,17cyclictest0-21swapper/120:24:051
20560992710,17cyclictest0-21swapper/120:13:401
20560992710,17cyclictest0-21swapper/119:53:071
20560992710,17cyclictest0-21swapper/119:44:011
20560992710,17cyclictest0-21swapper/119:33:031
20560992710,0cyclictest0-21swapper/120:46:291
20560992710,0cyclictest0-21swapper/120:35:561
20559992710,17cyclictest0-21swapper/020:59:580
20559992710,17cyclictest0-21swapper/020:46:310
20559992710,17cyclictest0-21swapper/020:36:000
20559992710,17cyclictest0-21swapper/020:13:430
20559992710,0cyclictest0-21swapper/021:53:440
20559992710,0cyclictest0-21swapper/020:23:370
20559992710,0cyclictest0-21swapper/019:53:100
20559992710,0cyclictest0-21swapper/019:43:340
20559992710,0cyclictest0-21swapper/019:33:080
20559992710,0cyclictest0-21swapper/019:13:450
20565992626,0cyclictest0-21swapper/620:23:386
20565992626,0cyclictest0-21swapper/619:13:396
20561992626,0cyclictest0-21swapper/220:59:572
20560992626,0cyclictest0-21swapper/120:59:571
20560992626,0cyclictest0-21swapper/120:02:271
20559992626,0cyclictest0-21swapper/020:02:290
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional